igt@xe_pat@pt-caching-random-offsets on shard-bmg@xe-pw-163428v3 Test details

Detail	Value
Duration	unknown
Hostname	shard-bmg-2
Igt-Version	IGT-Version: 2.4-g93abaf017 (x86_64) (Linux: 7.0.0-lgci-xe-xe-pw-163428v3-debug+ x86_64)
Out	Using IGT_SRANDOM=1776113298 for randomisation Opened device: /dev/dri/card0 Test requirement not met in function __igt_unique____real_main2210, file ../tests/intel/xe_pat.c:2298: Test requirement: intel_graphics_ver(dev_id) == IP_VER(35, 10) Last errno: 2, No such file or directory Starting subtest: pt-caching-random-offsets va_bits: 48, num_objs: 16384, spread over pt levels: -> random, seed: 1776113298 runner: This test was killed due to a kernel taint (0x244). runner: This test was killed due to exceeding disk usage limit. (Used 10839936 bytes, limit 10485760) This test caused an abort condition: Kernel badly tainted (0x244, 0x200) (check dmesg for details): TAINT_WARN: WARN_ON has happened.
Err	Starting subtest: pt-caching-random-offsets Received signal SIGQUIT. Stack trace: #0 [fatal_sig_handler+0x17b] #1 [__sigaction+0x50] #2 [ioctl+0x3b] #3 [drmIoctl+0x30] #4 [___xe_bo_create+0xe4] #5 [__xe_bo_create+0x48] #6 [xe_bo_create+0x26] #7 [pt_create_objects+0x22b] #8 [pt_caching_test+0x3c0] #9 [__igt_unique____real_main2210+0x142b] #10 [main+0x3a] #11 [__libc_init_first+0x8a] #12 [__libc_start_main+0x8b] #13 [_start+0x25]
Dmesg Scroll to first warning	<6> [85.928546] Console: switching to colour dummy device 80x25 <6> [85.928699] [IGT] xe_pat: executing <6> [85.937429] [IGT] xe_pat: starting subtest pt-caching-random-offsets <6> [86.002522] xe 0000:03:00.0: [drm] Tile0: GT0: ASID: 0 Faulted Address: 0x00000002fb493000 FaultType: 0 AccessType: 0 FaultLevel: 2 EngineClass: 3 bcs EngineInstance: 8 <6> [86.002535] xe 0000:03:00.0: [drm] Tile0: GT0: Fault response: Unsuccessful -EINVAL <6> [86.002623] xe 0000:03:00.0: [drm] Tile0: GT0: Engine memory CAT error [18]: class=bcs, logical_mask: 0x2, guc_id=0 <7> [86.003266] xe 0000:03:00.0: [drm:xe_hw_engine_snapshot_capture [xe]] Tile0: GT0: Proceeding with manual engine snapshot <6> [86.003923] xe 0000:03:00.0: [drm] Tile0: GT0: Engine reset: engine_class=bcs, logical_mask: 0x2, guc_id=0, state=0x249 <5> [86.003998] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=2709, lrc_seqno=2709, guc_id=0, flags=0x73 in no process [-1] <6> [86.185924] xe 0000:03:00.0: [drm] Xe device coredump has been created <6> [86.185942] xe 0000:03:00.0: [drm] Check your /sys/class/drm/card0/device/devcoredump/data <4> [86.185945] ------------[ cut here ]------------ <4> [86.185946] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.185948] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#1: kworker/u64:5/204 <4> [86.186039] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.186146] efi_pstore nfnetlink autofs4 <4> [86.186151] CPU: 1 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.186153] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER <4> [86.186155] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.186156] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.186162] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.186238] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.186241] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [86.186245] RAX: ffffffffa120354b RBX: ffff88810948e940 RCX: 0000000000000000 <4> [86.186247] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.186249] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.186251] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.186253] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000fffffffb <4> [86.186255] FS: 0000000000000000(0000) GS:ffff8888dad17000(0000) knlGS:0000000000000000 <4> [86.186257] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.186259] CR2: 000056c1d797b7b8 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [86.186261] PKRU: 55555554 <4> [86.186262] Call Trace: <4> [86.186264] <TASK> <4> [86.186268] ? lock_acquire+0xc4/0x2f0 <4> [86.186298] ? __pfx_autoremove_wake_function+0x10/0x10 <4> [86.186303] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.186308] process_one_work+0x239/0x760 <4> [86.186315] worker_thread+0x200/0x3f0 <4> [86.186318] ? __pfx_worker_thread+0x10/0x10 <4> [86.186320] kthread+0x10d/0x150 <4> [86.186323] ? __pfx_kthread+0x10/0x10 <4> [86.186327] ret_from_fork+0x3d4/0x480 <4> [86.186329] ? __pfx_kthread+0x10/0x10 <4> [86.186332] ret_from_fork_asm+0x1a/0x30 <4> [86.186339] </TASK> <4> [86.186340] irq event stamp: 307309 <4> [86.186342] hardirqs last enabled at (307315): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.186345] hardirqs last disabled at (307320): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.186347] softirqs last enabled at (306368): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.186349] softirqs last disabled at (306339): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.186351] ---[ end trace 0000000000000000 ]--- <6> [86.186354] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.186427] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.186686] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.187135] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.187561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.187655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.187743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.187825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.187907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.187987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.188069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.188152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.188233] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.188351] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.188460] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.189542] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.200280] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.200555] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.202137] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.202214] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.202311] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.202386] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.202456] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.202526] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.202595] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.202664] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.202731] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.202799] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.202869] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.202943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.203019] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.203094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.203169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.203254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.203328] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.203397] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.203464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.203541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.203617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.203689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.203761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.203831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.203900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.203969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.204039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.204110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.204181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.204267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.204345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.204423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.204506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.204590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.204673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.204756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.204840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.204918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.204997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.205074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.205154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.205236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.205313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.205390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.205470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.205546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.205624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.205703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.205785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.205864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.205941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.206020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.206099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.206179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.206268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.206348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.206426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.206502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.206583] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.207018] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.207024] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=2709, lrc_seqno=2709, guc_id=0, flags=0x73 in no process [-1] <7> [86.207027] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.207088] ------------[ cut here ]------------ <4> [86.207089] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.207091] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#1: kworker/u64:5/204 <4> [86.207165] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.207238] efi_pstore nfnetlink autofs4 <4> [86.207243] CPU: 1 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.207246] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.207247] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.207249] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.207254] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.207325] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.207327] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [86.207329] RAX: ffffffffa120354b RBX: ffff88810948e940 RCX: 0000000000000000 <4> [86.207331] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.207332] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.207333] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.207335] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.207336] FS: 0000000000000000(0000) GS:ffff8888dad17000(0000) knlGS:0000000000000000 <4> [86.207337] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.207339] CR2: 000056c1d797b7b8 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [86.207340] PKRU: 55555554 <4> [86.207342] Call Trace: <4> [86.207343] <TASK> <4> [86.207347] ? lock_acquire+0xc4/0x2f0 <4> [86.207353] ? lock_release+0xd0/0x2b0 <4> [86.207359] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.207364] process_one_work+0x239/0x760 <4> [86.207371] worker_thread+0x200/0x3f0 <4> [86.207374] ? __pfx_worker_thread+0x10/0x10 <4> [86.207376] kthread+0x10d/0x150 <4> [86.207379] ? __pfx_kthread+0x10/0x10 <4> [86.207383] ret_from_fork+0x3d4/0x480 <4> [86.207385] ? __pfx_kthread+0x10/0x10 <4> [86.207388] ret_from_fork_asm+0x1a/0x30 <4> [86.207396] </TASK> <4> [86.207397] irq event stamp: 310437 <4> [86.207398] hardirqs last enabled at (310443): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.207401] hardirqs last disabled at (310448): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.207404] softirqs last enabled at (309568): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.207406] softirqs last disabled at (309561): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.207409] ---[ end trace 0000000000000000 ]--- <6> [86.207411] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.207481] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.207487] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.207893] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.208097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.208187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.208296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.208386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.208475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.208562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.208648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.208735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.208817] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.208911] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.209027] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.210036] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.220579] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.220836] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.221821] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.221901] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.221977] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.222053] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.222127] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.222202] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.222298] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.222372] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.222446] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.222521] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.222595] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.222669] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.222742] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.222815] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.222891] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.222967] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.223042] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.223116] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.223190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.223280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.223362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.223442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.223521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.223601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.223681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.223758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.223837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.223920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.224001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.224079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.224158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.224247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.224332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.224417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.224506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.224590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.224671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.224749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.224827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.224903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.224983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.225062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.225139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.225218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.225298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.225374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.225451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.225527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.225604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.225679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.225755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.225837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.225918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.225997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.226074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.226153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.226235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.226312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.226391] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.226505] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.226510] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=2709, lrc_seqno=2709, guc_id=0, flags=0x73 in no process [-1] <7> [86.226513] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.226572] ------------[ cut here ]------------ <4> [86.226574] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.226575] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#1: kworker/u64:5/204 <4> [86.226647] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.226715] efi_pstore nfnetlink autofs4 <4> [86.226720] CPU: 1 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.226723] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.226724] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.226725] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.226731] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.226801] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.226803] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [86.226806] RAX: ffffffffa120354b RBX: ffff88810948e940 RCX: 0000000000000000 <4> [86.226807] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.226809] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.226810] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.226811] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.226813] FS: 0000000000000000(0000) GS:ffff8888dad17000(0000) knlGS:0000000000000000 <4> [86.226815] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.226816] CR2: 000056c1d797b7b8 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [86.226818] PKRU: 55555554 <4> [86.226819] Call Trace: <4> [86.226820] <TASK> <4> [86.226824] ? lock_acquire+0xc4/0x2f0 <4> [86.226830] ? lock_release+0xd0/0x2b0 <4> [86.226835] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.226841] process_one_work+0x239/0x760 <4> [86.226848] worker_thread+0x200/0x3f0 <4> [86.226851] ? __pfx_worker_thread+0x10/0x10 <4> [86.226853] kthread+0x10d/0x150 <4> [86.226857] ? __pfx_kthread+0x10/0x10 <4> [86.226860] ret_from_fork+0x3d4/0x480 <4> [86.226863] ? __pfx_kthread+0x10/0x10 <4> [86.226866] ret_from_fork_asm+0x1a/0x30 <4> [86.226873] </TASK> <4> [86.226875] irq event stamp: 313521 <4> [86.226876] hardirqs last enabled at (313527): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.226879] hardirqs last disabled at (313532): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.226881] softirqs last enabled at (312292): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.226884] softirqs last disabled at (312283): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.226886] ---[ end trace 0000000000000000 ]--- <5> [86.228437] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=2764, lrc_seqno=2764, guc_id=0, flags=0x73 in no process [-1] <7> [86.228444] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.228555] ------------[ cut here ]------------ <4> [86.228557] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.228560] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#12: kworker/u64:1/120 <4> [86.228679] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.228771] efi_pstore nfnetlink autofs4 <4> [86.228777] CPU: 12 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <7> [86.228724] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [86.228781] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.228783] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.228785] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.228792] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <7> [86.228837] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [86.228908] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.228910] RSP: 0018:ffffc9000055bc98 EFLAGS: 00010246 <4> [86.228913] RAX: ffffffffa120354b RBX: ffff8881721a0c40 RCX: 0000000000000000 <4> [86.228915] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.228916] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.228918] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.228920] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.228921] FS: 0000000000000000(0000) GS:ffff8888db297000(0000) knlGS:0000000000000000 <4> [86.228923] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.228925] CR2: 00005a59b12e1b40 CR3: 000000012bf77001 CR4: 0000000000f72ef0 <4> [86.228927] PKRU: 55555554 <4> [86.228928] Call Trace: <4> [86.228929] <TASK> <4> [86.228936] ? lock_acquire+0xc4/0x2f0 <4> [86.228947] ? lock_release+0xd0/0x2b0 <4> [86.228956] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.228966] process_one_work+0x239/0x760 <4> [86.228976] worker_thread+0x200/0x3f0 <4> [86.228980] ? __pfx_worker_thread+0x10/0x10 <4> [86.228984] kthread+0x10d/0x150 <4> [86.228988] ? __pfx_kthread+0x10/0x10 <4> [86.228994] ret_from_fork+0x3d4/0x480 <4> [86.228997] ? __pfx_kthread+0x10/0x10 <4> [86.229002] ret_from_fork_asm+0x1a/0x30 <4> [86.229014] </TASK> <4> [86.229016] irq event stamp: 306407 <4> [86.229017] hardirqs last enabled at (306413): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.229021] hardirqs last disabled at (306418): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.229025] softirqs last enabled at (301322): [<ffffffff8133ac13>] kernel_fpu_end+0x53/0x70 <4> [86.229028] softirqs last disabled at (301320): [<ffffffff8133b324>] kernel_fpu_begin_mask+0xc4/0x120 <4> [86.229031] ---[ end trace 0000000000000000 ]--- <6> [86.229035] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.229149] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.229159] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.229240] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.229501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.229637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.229776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.229909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.230041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.230172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.230311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.230447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.230576] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.230721] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.230887] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.232284] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.242222] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.242535] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.243903] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.244025] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.244143] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.244273] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.244395] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.244517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.244637] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.244757] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.244877] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.244997] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.245118] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.245244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.245366] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.245486] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.245606] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.245727] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.245846] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.245967] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.246087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.246216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.246343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.246468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.246593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.246716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.246839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.246962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.247086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.247216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.247344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.247470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.247596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.247723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.247854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.247985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.248116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.248250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.248379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.248503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.248627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.248751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.248878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.249004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.249128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.249260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.249390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.249515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.249639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.249762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.249887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.250010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.250133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.250277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.250371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.250459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.250542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.250626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.250710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.250789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.250870] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.250984] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.250988] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=2764, lrc_seqno=2764, guc_id=0, flags=0x73 in no process [-1] <7> [86.250990] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.251049] ------------[ cut here ]------------ <4> [86.251051] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.251052] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#4: kworker/u64:1/120 <4> [86.251124] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.251189] efi_pstore nfnetlink autofs4 <4> [86.251193] CPU: 4 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.251196] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.251197] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.251199] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.251204] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.251291] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.251293] RSP: 0018:ffffc9000055bc98 EFLAGS: 00010246 <4> [86.251296] RAX: ffffffffa120354b RBX: ffff8881721a0c40 RCX: 0000000000000000 <4> [86.251297] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.251299] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.251300] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.251301] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.251303] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [86.251304] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.251306] CR2: 000071186c9e62f4 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.251307] PKRU: 55555554 <4> [86.251308] Call Trace: <4> [86.251309] <TASK> <4> [86.251314] ? lock_acquire+0xc4/0x2f0 <4> [86.251318] ? lock_release+0xd0/0x2b0 <4> [86.251324] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.251329] process_one_work+0x239/0x760 <4> [86.251336] worker_thread+0x200/0x3f0 <4> [86.251338] ? __pfx_worker_thread+0x10/0x10 <4> [86.251341] kthread+0x10d/0x150 <4> [86.251344] ? __pfx_kthread+0x10/0x10 <4> [86.251348] ret_from_fork+0x3d4/0x480 <4> [86.251350] ? __pfx_kthread+0x10/0x10 <4> [86.251353] ret_from_fork_asm+0x1a/0x30 <4> [86.251360] </TASK> <4> [86.251362] irq event stamp: 309525 <4> [86.251363] hardirqs last enabled at (309531): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.251366] hardirqs last disabled at (309536): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.251368] softirqs last enabled at (309364): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.251371] softirqs last disabled at (309357): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.251373] ---[ end trace 0000000000000000 ]--- <6> [86.251375] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.251446] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.251453] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.252857] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [86.252964] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [86.253089] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.253302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.253396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.253491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.253580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.253666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.253751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.253838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.253929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.254013] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.254108] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.254231] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.255244] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.265966] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.266216] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.267244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.267326] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.267402] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.267479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.267555] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.267631] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.267707] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.267781] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.267858] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.267936] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.268013] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.268088] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.268163] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.268248] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.268322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.268396] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.268468] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.268541] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.268615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.268696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.268777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.268857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.268938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.269015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.269092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.269168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.269253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.269332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.269411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.269490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.269569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.269647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.269730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.269813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.269896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.269976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.270059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.270140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.270229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.270308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.270389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.270467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.270545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.270622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.270703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.270783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.270865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.270942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.271021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.271098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.271175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.271262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.271340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.271417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.271493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.271573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.271653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.271730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.271811] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.271924] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.271928] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=2764, lrc_seqno=2764, guc_id=0, flags=0x73 in no process [-1] <7> [86.271931] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.271988] ------------[ cut here ]------------ <4> [86.271990] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.271991] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#0: kworker/u64:5/204 <4> [86.272062] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.272127] efi_pstore nfnetlink autofs4 <4> [86.272131] CPU: 0 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.272135] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.272136] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.272138] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.272143] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.272217] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.272220] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [86.272223] RAX: ffffffffa120354b RBX: ffff8881721a0c40 RCX: 0000000000000000 <4> [86.272225] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.272226] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.272228] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.272229] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.272231] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [86.272232] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.272234] CR2: 00007724b3cbd4b0 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.272235] PKRU: 55555554 <4> [86.272236] Call Trace: <4> [86.272237] <TASK> <4> [86.272242] ? lock_acquire+0xc4/0x2f0 <4> [86.272246] ? lock_release+0xd0/0x2b0 <4> [86.272252] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.272258] process_one_work+0x239/0x760 <4> [86.272264] worker_thread+0x200/0x3f0 <4> [86.272267] ? __pfx_worker_thread+0x10/0x10 <4> [86.272269] kthread+0x10d/0x150 <4> [86.272272] ? __pfx_kthread+0x10/0x10 <4> [86.272276] ret_from_fork+0x3d4/0x480 <4> [86.272278] ? __pfx_kthread+0x10/0x10 <4> [86.272281] ret_from_fork_asm+0x1a/0x30 <4> [86.272289] </TASK> <4> [86.272290] irq event stamp: 317417 <4> [86.272291] hardirqs last enabled at (317423): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.272294] hardirqs last disabled at (317428): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.272296] softirqs last enabled at (316438): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.272299] softirqs last disabled at (316433): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.272301] ---[ end trace 0000000000000000 ]--- <7> [86.273829] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [86.273939] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [86.274037] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=2819, lrc_seqno=2819, guc_id=0, flags=0x73 in no process [-1] <7> [86.274039] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.274100] ------------[ cut here ]------------ <4> [86.274101] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.274102] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#0: kworker/u64:5/204 <4> [86.274176] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.274251] efi_pstore nfnetlink autofs4 <4> [86.274255] CPU: 0 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.274258] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.274259] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.274261] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.274266] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.274337] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.274339] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [86.274341] RAX: ffffffffa120354b RBX: ffff888172569540 RCX: 0000000000000000 <4> [86.274342] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.274343] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.274345] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.274346] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.274347] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [86.274349] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.274350] CR2: 00007724b3cbd4b0 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.274351] PKRU: 55555554 <4> [86.274353] Call Trace: <4> [86.274354] <TASK> <4> [86.274358] ? lock_acquire+0xc4/0x2f0 <4> [86.274362] ? lock_release+0xd0/0x2b0 <4> [86.274367] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.274372] process_one_work+0x239/0x760 <4> [86.274378] worker_thread+0x200/0x3f0 <4> [86.274381] ? __pfx_worker_thread+0x10/0x10 <4> [86.274383] kthread+0x10d/0x150 <4> [86.274386] ? __pfx_kthread+0x10/0x10 <4> [86.274390] ret_from_fork+0x3d4/0x480 <4> [86.274392] ? __pfx_kthread+0x10/0x10 <4> [86.274395] ret_from_fork_asm+0x1a/0x30 <4> [86.274402] </TASK> <4> [86.274403] irq event stamp: 320097 <4> [86.274405] hardirqs last enabled at (320103): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.274407] hardirqs last disabled at (320108): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.274409] softirqs last enabled at (319548): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.274412] softirqs last disabled at (319541): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.274414] ---[ end trace 0000000000000000 ]--- <6> [86.274416] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.274486] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.274493] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.274540] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.274743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.274831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.274923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.275010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.275097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.275185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.275290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.275379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.275462] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.275557] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.275674] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.276681] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.287207] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.287621] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.288640] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.288720] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.288797] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.288874] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.288951] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.289030] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.289108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.289184] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.289274] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.289349] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.289424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.289498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.289572] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.289645] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.289718] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.289792] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.289866] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.289942] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.290019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.290103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.290185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.290283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.290365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.290445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.290523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.290600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.290676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.290757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.290837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.290914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.290992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.291071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.291158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.291258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.291345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.291427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.291507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.291585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.291661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.291738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.291817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.291896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.291973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.292053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.292136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.292216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.292295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.292371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.292448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.292524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.292600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.292679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.292756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.292832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.292908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.292985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.293060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.293137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.293223] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.293334] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.293338] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=2819, lrc_seqno=2819, guc_id=0, flags=0x73 in no process [-1] <7> [86.293341] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.293400] ------------[ cut here ]------------ <4> [86.293401] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.293402] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#0: kworker/u64:5/204 <4> [86.293473] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.293537] efi_pstore nfnetlink autofs4 <4> [86.293541] CPU: 0 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.293544] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.293545] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.293547] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.293552] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.293621] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.293623] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [86.293625] RAX: ffffffffa120354b RBX: ffff888172569540 RCX: 0000000000000000 <4> [86.293627] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.293628] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.293629] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.293630] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.293632] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [86.293633] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.293635] CR2: 00007724b3cbd4b0 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.293636] PKRU: 55555554 <4> [86.293637] Call Trace: <4> [86.293638] <TASK> <4> [86.293642] ? lock_acquire+0xc4/0x2f0 <4> [86.293647] ? lock_release+0xd0/0x2b0 <4> [86.293652] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.293658] process_one_work+0x239/0x760 <4> [86.293664] worker_thread+0x200/0x3f0 <4> [86.293666] ? __pfx_worker_thread+0x10/0x10 <4> [86.293669] kthread+0x10d/0x150 <4> [86.293672] ? __pfx_kthread+0x10/0x10 <4> [86.293675] ret_from_fork+0x3d4/0x480 <4> [86.293677] ? __pfx_kthread+0x10/0x10 <4> [86.293681] ret_from_fork_asm+0x1a/0x30 <4> [86.293688] </TASK> <4> [86.293689] irq event stamp: 323171 <4> [86.293690] hardirqs last enabled at (323177): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.293693] hardirqs last disabled at (323182): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.293695] softirqs last enabled at (321958): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.293698] softirqs last disabled at (321953): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.293700] ---[ end trace 0000000000000000 ]--- <6> [86.293702] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.293771] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.293777] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.295017] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [86.295120] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [86.295235] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.295446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.295539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.295634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.295722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.295809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.295895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.295980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.296067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.296148] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.296256] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.296385] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.297398] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.308121] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.308382] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.309411] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.309493] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.309570] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.309649] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.309725] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.309800] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.309876] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.309951] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.310026] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.310100] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.310175] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.310265] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.310348] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.310422] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.310496] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.310571] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.310645] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.310719] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.310793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.310878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.310961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.311041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.311120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.311204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.311291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.311368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.311444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.311524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.311605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.311683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.311762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.311843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.311933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.312022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.312109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.312197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.312289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.312369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.312447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.312524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.312604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.312682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.312760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.312837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.312918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.312994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.313071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.313147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.313240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.313330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.313411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.313493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.313572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.313650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.313726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.313803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.313880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.313956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.314038] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.314149] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.314154] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=2819, lrc_seqno=2819, guc_id=0, flags=0x73 in no process [-1] <7> [86.314156] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.314232] ------------[ cut here ]------------ <4> [86.314234] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.314237] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#11: kworker/u64:0/12 <4> [86.314320] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.314384] efi_pstore nfnetlink autofs4 <4> [86.314389] CPU: 11 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.314392] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.314393] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.314394] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.314400] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.314470] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.314472] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [86.314474] RAX: ffffffffa120354b RBX: ffff888172569540 RCX: 0000000000000000 <4> [86.314475] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.314477] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.314478] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.314479] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.314480] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [86.314482] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.314483] CR2: 00007099c41e62f4 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [86.314485] PKRU: 55555554 <4> [86.314486] Call Trace: <4> [86.314487] <TASK> <4> [86.314491] ? lock_acquire+0xc4/0x2f0 <4> [86.314496] ? lock_release+0xd0/0x2b0 <4> [86.314501] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.314507] process_one_work+0x239/0x760 <4> [86.314513] worker_thread+0x200/0x3f0 <4> [86.314516] ? __pfx_worker_thread+0x10/0x10 <4> [86.314518] kthread+0x10d/0x150 <4> [86.314521] ? __pfx_kthread+0x10/0x10 <4> [86.314525] ret_from_fork+0x3d4/0x480 <4> [86.314527] ? __pfx_kthread+0x10/0x10 <4> [86.314530] ret_from_fork_asm+0x1a/0x30 <4> [86.314537] </TASK> <4> [86.314539] irq event stamp: 1122885 <4> [86.314540] hardirqs last enabled at (1122891): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.314543] hardirqs last disabled at (1122896): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.314545] softirqs last enabled at (1122124): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.314547] softirqs last disabled at (1122117): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.314549] ---[ end trace 0000000000000000 ]--- <5> [86.315278] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=2874, lrc_seqno=2874, guc_id=0, flags=0x73 in no process [-1] <7> [86.315283] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.315382] ------------[ cut here ]------------ <4> [86.315383] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.315385] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#0: kworker/u64:5/204 <4> [86.315461] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.315530] efi_pstore nfnetlink autofs4 <4> [86.315535] CPU: 0 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.315538] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.315539] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.315541] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.315549] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.315622] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.315624] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [86.315627] RAX: ffffffffa120354b RBX: ffff8881725b6040 RCX: 0000000000000000 <4> [86.315628] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.315629] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.315630] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.315632] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.315633] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [86.315635] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.315636] CR2: 00007724b3cbd4b0 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.315638] PKRU: 55555554 <4> [86.315640] Call Trace: <4> [86.315641] <TASK> <4> [86.315646] ? lock_acquire+0xc4/0x2f0 <4> [86.315651] ? lock_release+0xd0/0x2b0 <4> [86.315656] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.315662] process_one_work+0x239/0x760 <4> [86.315669] worker_thread+0x200/0x3f0 <4> [86.315672] ? __pfx_worker_thread+0x10/0x10 <4> [86.315674] kthread+0x10d/0x150 <4> [86.315678] ? __pfx_kthread+0x10/0x10 <4> [86.315681] ret_from_fork+0x3d4/0x480 <4> [86.315683] ? __pfx_kthread+0x10/0x10 <4> [86.315686] ret_from_fork_asm+0x1a/0x30 <4> [86.315694] </TASK> <4> [86.315695] irq event stamp: 326491 <4> [86.315696] hardirqs last enabled at (326497): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.315700] hardirqs last disabled at (326502): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.315703] softirqs last enabled at (325666): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.315705] softirqs last disabled at (325661): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.315708] ---[ end trace 0000000000000000 ]--- <6> [86.315712] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.315788] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.315797] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.316143] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [86.316278] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [86.316389] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.316592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.316680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.316773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.316863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.316950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.317036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.317128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.317224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.317308] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.317405] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.317523] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.318530] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.329194] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.329444] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.330456] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.330535] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.330612] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.330690] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.330765] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.330840] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.330915] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.330989] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.331063] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.331137] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.331224] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.331302] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.331379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.331455] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.331532] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.331607] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.331681] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.331754] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.331827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.331908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.331991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.332072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.332153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.332244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.332322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.332399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.332475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.332554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.332633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.332713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.332790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.332867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.332954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.333040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.333126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.333211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.333291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.333369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.333446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.333522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.333604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.333687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.333767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.333846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.333927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.334004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.334082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.334158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.334262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.334338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.334415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.334496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.334577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.334657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.334735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.334813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.334889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.334966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.335046] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.335158] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.335162] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=2874, lrc_seqno=2874, guc_id=0, flags=0x73 in no process [-1] <7> [86.335164] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.335240] ------------[ cut here ]------------ <4> [86.335241] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.335242] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#0: kworker/u64:5/204 <4> [86.335315] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.335380] efi_pstore nfnetlink autofs4 <4> [86.335384] CPU: 0 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.335387] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.335388] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.335390] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.335395] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.335465] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.335466] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [86.335469] RAX: ffffffffa120354b RBX: ffff8881725b6040 RCX: 0000000000000000 <4> [86.335470] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.335471] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.335473] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.335474] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.335475] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [86.335477] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.335478] CR2: 00007724b3cbd4b0 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.335480] PKRU: 55555554 <4> [86.335481] Call Trace: <4> [86.335482] <TASK> <4> [86.335486] ? lock_acquire+0xc4/0x2f0 <4> [86.335490] ? lock_release+0xd0/0x2b0 <4> [86.335495] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.335501] process_one_work+0x239/0x760 <4> [86.335507] worker_thread+0x200/0x3f0 <4> [86.335510] ? __pfx_worker_thread+0x10/0x10 <4> [86.335512] kthread+0x10d/0x150 <4> [86.335515] ? __pfx_kthread+0x10/0x10 <4> [86.335518] ret_from_fork+0x3d4/0x480 <4> [86.335520] ? __pfx_kthread+0x10/0x10 <4> [86.335524] ret_from_fork_asm+0x1a/0x30 <4> [86.335531] </TASK> <4> [86.335532] irq event stamp: 329723 <4> [86.335533] hardirqs last enabled at (329729): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.335536] hardirqs last disabled at (329734): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.335538] softirqs last enabled at (328962): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.335541] softirqs last disabled at (328955): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.335543] ---[ end trace 0000000000000000 ]--- <6> [86.335545] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.335613] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.335619] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.336859] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [86.336962] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [86.337067] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.337278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.337369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.337463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.337552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.337640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.337727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.337815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.337904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.337988] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.338083] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.338207] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.339221] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.349206] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.349454] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.350429] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.350509] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.350586] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.350665] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.350745] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.350823] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.350898] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.350974] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.351048] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.351122] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.351199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.351273] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.351348] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.351420] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.351497] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.351575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.351651] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.351725] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.351799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.351881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.351963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.352042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.352122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.352205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.352282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.352363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.352444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.352525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.352605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.352684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.352763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.352842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.352926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.353010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.353095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.353175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.353269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.353346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.353424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.353503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.353589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.353669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.353747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.353824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.353905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.353982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.354060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.354136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.354223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.354299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.354375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.354454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.354531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.354612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.354692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.354771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.354849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.354926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.355005] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.355115] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.355119] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=2874, lrc_seqno=2874, guc_id=0, flags=0x73 in no process [-1] <7> [86.355122] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.355183] ------------[ cut here ]------------ <4> [86.355184] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.355186] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#11: kworker/u64:0/12 <4> [86.355257] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.355321] efi_pstore nfnetlink autofs4 <4> [86.355326] CPU: 11 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.355329] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.355330] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.355331] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.355337] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.355407] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.355409] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [86.355411] RAX: ffffffffa120354b RBX: ffff8881725b6040 RCX: 0000000000000000 <4> [86.355412] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.355414] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.355415] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.355416] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.355417] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [86.355419] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.355420] CR2: 00007099c41e62f4 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [86.355422] PKRU: 55555554 <4> [86.355423] Call Trace: <4> [86.355424] <TASK> <4> [86.355428] ? lock_acquire+0xc4/0x2f0 <4> [86.355433] ? lock_release+0xd0/0x2b0 <4> [86.355438] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.355444] process_one_work+0x239/0x760 <4> [86.355450] worker_thread+0x200/0x3f0 <4> [86.355453] ? __pfx_worker_thread+0x10/0x10 <4> [86.355455] kthread+0x10d/0x150 <4> [86.355458] ? __pfx_kthread+0x10/0x10 <4> [86.355462] ret_from_fork+0x3d4/0x480 <4> [86.355464] ? __pfx_kthread+0x10/0x10 <4> [86.355467] ret_from_fork_asm+0x1a/0x30 <4> [86.355474] </TASK> <4> [86.355476] irq event stamp: 1128233 <4> [86.355477] hardirqs last enabled at (1128239): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.355479] hardirqs last disabled at (1128244): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.355482] softirqs last enabled at (1127238): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.355484] softirqs last disabled at (1127231): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.355486] ---[ end trace 0000000000000000 ]--- <5> [86.356862] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=2929, lrc_seqno=2929, guc_id=0, flags=0x73 in no process [-1] <7> [86.356865] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.356934] ------------[ cut here ]------------ <4> [86.356935] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.356937] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#11: kworker/u64:0/12 <4> [86.357008] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.357072] efi_pstore nfnetlink autofs4 <4> [86.357076] CPU: 11 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.357078] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.357079] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.357081] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.357085] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.357154] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.357156] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [86.357158] RAX: ffffffffa120354b RBX: ffff888170788040 RCX: 0000000000000000 <4> [86.357159] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.357160] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.357162] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.357163] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.357164] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [86.357165] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.357167] CR2: 00007099c41e62f4 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [86.357168] PKRU: 55555554 <4> [86.357169] Call Trace: <4> [86.357170] <TASK> <4> [86.357174] ? lock_acquire+0xc4/0x2f0 <4> [86.357178] ? lock_release+0xd0/0x2b0 <4> [86.357197] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.357203] process_one_work+0x239/0x760 <4> [86.357209] worker_thread+0x200/0x3f0 <4> [86.357212] ? __pfx_worker_thread+0x10/0x10 <4> [86.357214] kthread+0x10d/0x150 <4> [86.357217] ? __pfx_kthread+0x10/0x10 <4> [86.357221] ret_from_fork+0x3d4/0x480 <4> [86.357223] ? __pfx_kthread+0x10/0x10 <4> [86.357226] ret_from_fork_asm+0x1a/0x30 <4> [86.357233] </TASK> <4> [86.357234] irq event stamp: 1130899 <4> [86.357236] hardirqs last enabled at (1130905): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.357238] hardirqs last disabled at (1130910): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.357241] softirqs last enabled at (1130834): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.357243] softirqs last disabled at (1130795): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.357245] ---[ end trace 0000000000000000 ]--- <7> [86.357265] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [86.357368] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [86.357466] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.357535] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.357541] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.357588] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.357791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.357878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.357970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.358059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.358146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.358247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.358332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.358419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.358501] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.358595] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.358713] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.359721] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.370185] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.370435] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.371444] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.371524] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.371601] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.371677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.371755] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.371832] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.371907] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.371981] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.372055] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.372129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.372212] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.372285] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.372358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.372432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.372506] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.372578] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.372653] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.372730] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.372808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.372889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.372971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.373049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.373130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.373215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.373293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.373369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.373447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.373529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.373610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.373689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.373769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.373847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.373931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.374019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.374106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.374198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.374279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.374357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.374436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.374513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.374594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.374675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.374754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.374835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.374919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.374999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.375077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.375154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.375248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.375325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.375405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.375487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.375567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.375647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.375725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.375804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.375882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.375959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.376039] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.376149] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.376153] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=2929, lrc_seqno=2929, guc_id=0, flags=0x73 in no process [-1] <7> [86.376156] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.376233] ------------[ cut here ]------------ <4> [86.376235] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.376236] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#0: kworker/u64:5/204 <4> [86.376309] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.376372] efi_pstore nfnetlink autofs4 <4> [86.376377] CPU: 0 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.376379] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.376381] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.376382] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.376387] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.376458] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.376459] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [86.376461] RAX: ffffffffa120354b RBX: ffff888170788040 RCX: 0000000000000000 <4> [86.376463] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.376464] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.376465] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.376466] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.376468] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [86.376469] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.376471] CR2: 00007724b3cbd4b0 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.376472] PKRU: 55555554 <4> [86.376473] Call Trace: <4> [86.376474] <TASK> <4> [86.376478] ? lock_acquire+0xc4/0x2f0 <4> [86.376483] ? lock_release+0xd0/0x2b0 <4> [86.376488] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.376494] process_one_work+0x239/0x760 <4> [86.376500] worker_thread+0x200/0x3f0 <4> [86.376502] ? __pfx_worker_thread+0x10/0x10 <4> [86.376505] kthread+0x10d/0x150 <4> [86.376507] ? __pfx_kthread+0x10/0x10 <4> [86.376511] ret_from_fork+0x3d4/0x480 <4> [86.376513] ? __pfx_kthread+0x10/0x10 <4> [86.376516] ret_from_fork_asm+0x1a/0x30 <4> [86.376524] </TASK> <4> [86.376525] irq event stamp: 332841 <4> [86.376526] hardirqs last enabled at (332847): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.376529] hardirqs last disabled at (332852): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.376531] softirqs last enabled at (332080): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.376533] softirqs last disabled at (332069): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.376535] ---[ end trace 0000000000000000 ]--- <6> [86.376537] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.376607] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.376613] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.377842] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [86.377947] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [86.378053] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.378263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.378355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.378447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.378534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.378621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.378705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.378789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.378876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.378958] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.379053] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.379170] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.380192] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.390181] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.390430] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.391434] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.391514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.391590] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.391666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.391741] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.391816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.391891] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.391965] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.392040] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.392115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.392194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.392269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.392346] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.392423] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.392499] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.392573] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.392648] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.392723] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.392797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.392878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.392959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.393040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.393121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.393206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.393285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.393361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.393438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.393516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.393596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.393673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.393751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.393829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.393915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.394002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.394087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.394168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.394259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.394336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.394413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.394488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.394568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.394645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.394722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.394802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.394885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.394964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.395042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.395118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.395201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.395275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.395351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.395429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.395509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.395589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.395667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.395746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.395825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.395905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.395987] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.396098] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.396102] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=2929, lrc_seqno=2929, guc_id=0, flags=0x73 in no process [-1] <7> [86.396104] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.396163] ------------[ cut here ]------------ <4> [86.396164] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.396166] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#4: kworker/u64:1/120 <4> [86.396253] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.396319] efi_pstore nfnetlink autofs4 <4> [86.396324] CPU: 4 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.396327] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.396328] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.396329] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.396334] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.396404] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.396406] RSP: 0018:ffffc9000055bc98 EFLAGS: 00010246 <4> [86.396408] RAX: ffffffffa120354b RBX: ffff888170788040 RCX: 0000000000000000 <4> [86.396409] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.396411] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.396412] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.396413] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.396414] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [86.396416] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.396417] CR2: 000071186c9e62f4 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.396419] PKRU: 55555554 <4> [86.396420] Call Trace: <4> [86.396421] <TASK> <4> [86.396425] ? lock_acquire+0xc4/0x2f0 <4> [86.396430] ? lock_release+0xd0/0x2b0 <4> [86.396435] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.396441] process_one_work+0x239/0x760 <4> [86.396447] worker_thread+0x200/0x3f0 <4> [86.396450] ? __pfx_worker_thread+0x10/0x10 <4> [86.396452] kthread+0x10d/0x150 <4> [86.396455] ? __pfx_kthread+0x10/0x10 <4> [86.396459] ret_from_fork+0x3d4/0x480 <4> [86.396461] ? __pfx_kthread+0x10/0x10 <4> [86.396464] ret_from_fork_asm+0x1a/0x30 <4> [86.396471] </TASK> <4> [86.396472] irq event stamp: 316769 <4> [86.396473] hardirqs last enabled at (316775): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.396476] hardirqs last disabled at (316780): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.396478] softirqs last enabled at (316026): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.396481] softirqs last disabled at (316015): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.396483] ---[ end trace 0000000000000000 ]--- <5> [86.397168] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=2984, lrc_seqno=2984, guc_id=0, flags=0x73 in no process [-1] <7> [86.397180] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.397283] ------------[ cut here ]------------ <4> [86.397285] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.397287] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#11: kworker/u64:0/12 <4> [86.397381] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.397449] efi_pstore nfnetlink autofs4 <4> [86.397455] CPU: 11 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.397458] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.397460] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.397462] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.397470] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.397551] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.397553] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [86.397555] RAX: ffffffffa120354b RBX: ffff8881707d2440 RCX: 0000000000000000 <4> [86.397557] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.397558] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.397560] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.397561] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.397563] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [86.397564] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.397565] CR2: 00007099c41e62f4 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [86.397567] PKRU: 55555554 <4> [86.397568] Call Trace: <4> [86.397569] <TASK> <4> [86.397575] ? lock_acquire+0xc4/0x2f0 <4> [86.397580] ? lock_release+0xd0/0x2b0 <4> [86.397585] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.397591] process_one_work+0x239/0x760 <4> [86.397597] worker_thread+0x200/0x3f0 <4> [86.397600] ? __pfx_worker_thread+0x10/0x10 <4> [86.397602] kthread+0x10d/0x150 <4> [86.397607] ? __pfx_kthread+0x10/0x10 <4> [86.397610] ret_from_fork+0x3d4/0x480 <4> [86.397613] ? __pfx_kthread+0x10/0x10 <4> [86.397617] ret_from_fork_asm+0x1a/0x30 <4> [86.397625] </TASK> <4> [86.397627] irq event stamp: 1132237 <4> [86.397628] hardirqs last enabled at (1132243): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.397631] hardirqs last disabled at (1132248): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.397633] softirqs last enabled at (1131470): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.397636] softirqs last disabled at (1131465): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.397638] ---[ end trace 0000000000000000 ]--- <6> [86.397641] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.397724] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.397739] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.397881] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [86.397986] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [86.398092] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.398307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.398399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.398497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.398615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.398703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.398795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.398886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.398975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.399058] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.399175] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.399293] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.400325] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.411048] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.411300] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.412354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.412435] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.412512] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.412590] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.412669] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.412747] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.412823] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.412897] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.412971] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.413045] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.413119] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.413207] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.413280] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.413354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.413428] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.413528] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.413602] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.413686] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.413762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.413852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.413934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.414013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.414115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.414212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.414291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.414373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.414449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.414528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.414626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.414712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.414795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.414873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.414964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.415048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.415131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.415249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.415346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.415433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.415515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.415597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.415677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.415767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.415860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.415947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.416031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.416115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.416203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.416279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.416374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.416449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.416524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.416602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.416677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.416755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.416835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.416916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.416993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.417071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.417150] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.417276] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.417280] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=2984, lrc_seqno=2984, guc_id=0, flags=0x73 in no process [-1] <7> [86.417283] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.417342] ------------[ cut here ]------------ <4> [86.417343] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.417345] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#11: kworker/u64:0/12 <4> [86.417417] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.417482] efi_pstore nfnetlink autofs4 <4> [86.417486] CPU: 11 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.417489] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.417490] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.417492] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.417497] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.417567] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.417569] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [86.417571] RAX: ffffffffa120354b RBX: ffff8881707d2440 RCX: 0000000000000000 <4> [86.417572] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.417573] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.417575] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.417576] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.417577] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [86.417579] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.417580] CR2: 00007099c41e62f4 CR3: 000000012bf77001 CR4: 0000000000f72ef0 <4> [86.417582] PKRU: 55555554 <4> [86.417583] Call Trace: <4> [86.417584] <TASK> <4> [86.417588] ? lock_acquire+0xc4/0x2f0 <4> [86.417593] ? lock_release+0xd0/0x2b0 <4> [86.417598] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.417603] process_one_work+0x239/0x760 <4> [86.417610] worker_thread+0x200/0x3f0 <4> [86.417612] ? __pfx_worker_thread+0x10/0x10 <4> [86.417615] kthread+0x10d/0x150 <4> [86.417617] ? __pfx_kthread+0x10/0x10 <4> [86.417621] ret_from_fork+0x3d4/0x480 <4> [86.417623] ? __pfx_kthread+0x10/0x10 <4> [86.417626] ret_from_fork_asm+0x1a/0x30 <4> [86.417634] </TASK> <4> [86.417635] irq event stamp: 1135335 <4> [86.417636] hardirqs last enabled at (1135341): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.417639] hardirqs last disabled at (1135346): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.417641] softirqs last enabled at (1134238): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.417643] softirqs last disabled at (1134231): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.417645] ---[ end trace 0000000000000000 ]--- <6> [86.417648] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.417717] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.417722] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.418962] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [86.419065] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [86.419174] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.419378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.419466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.419558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.419647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.419737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.419826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.419913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.420001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.420084] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.420183] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.420299] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.421305] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.431174] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.431424] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.432447] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.432528] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.432606] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.432684] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.432760] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.432838] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.432914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.432990] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.433065] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.433139] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.433220] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.433293] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.433367] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.433440] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.433514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.433589] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.433663] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.433736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.433809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.433890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.433970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.434049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.434131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.434219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.434299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.434375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.434453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.434532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.434610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.434688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.434771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.434854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.434940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.435025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.435110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.435198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.435278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.435355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.435433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.435509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.435588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.435666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.435743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.435818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.435898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.435976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.436056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.436134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.436221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.436297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.436373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.436453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.436530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.436608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.436683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.436759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.436833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.436909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.436989] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.437100] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.437104] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=2984, lrc_seqno=2984, guc_id=0, flags=0x73 in no process [-1] <7> [86.437106] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.437171] ------------[ cut here ]------------ <4> [86.437172] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.437174] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#4: kworker/u64:1/120 <4> [86.437246] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.437310] efi_pstore nfnetlink autofs4 <4> [86.437314] CPU: 4 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.437317] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.437318] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.437319] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.437324] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.437395] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.437396] RSP: 0018:ffffc9000055bc98 EFLAGS: 00010246 <4> [86.437398] RAX: ffffffffa120354b RBX: ffff8881707d2440 RCX: 0000000000000000 <4> [86.437400] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.437401] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.437402] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.437403] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.437405] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [86.437406] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.437408] CR2: 000071186c9e62f4 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.437409] PKRU: 55555554 <4> [86.437410] Call Trace: <4> [86.437411] <TASK> <4> [86.437415] ? lock_acquire+0xc4/0x2f0 <4> [86.437420] ? lock_release+0xd0/0x2b0 <4> [86.437425] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.437431] process_one_work+0x239/0x760 <4> [86.437437] worker_thread+0x200/0x3f0 <4> [86.437439] ? __pfx_worker_thread+0x10/0x10 <4> [86.437442] kthread+0x10d/0x150 <4> [86.437444] ? __pfx_kthread+0x10/0x10 <4> [86.437448] ret_from_fork+0x3d4/0x480 <4> [86.437450] ? __pfx_kthread+0x10/0x10 <4> [86.437453] ret_from_fork_asm+0x1a/0x30 <4> [86.437461] </TASK> <4> [86.437462] irq event stamp: 321241 <4> [86.437463] hardirqs last enabled at (321247): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.437465] hardirqs last disabled at (321252): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.437468] softirqs last enabled at (320238): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.437470] softirqs last disabled at (320231): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.437472] ---[ end trace 0000000000000000 ]--- <5> [86.438927] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3039, lrc_seqno=3039, guc_id=0, flags=0x73 in no process [-1] <7> [86.438930] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.438991] ------------[ cut here ]------------ <4> [86.438992] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.438993] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#4: kworker/u64:1/120 <4> [86.439063] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.439126] efi_pstore nfnetlink autofs4 <4> [86.439130] CPU: 4 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.439132] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.439133] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.439134] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.439139] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.439217] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.439219] RSP: 0018:ffffc9000055bc98 EFLAGS: 00010246 <4> [86.439221] RAX: ffffffffa120354b RBX: ffff888174698f40 RCX: 0000000000000000 <4> [86.439223] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.439224] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.439225] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.439227] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.439228] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [86.439230] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.439231] CR2: 000071186c9e62f4 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.439233] PKRU: 55555554 <4> [86.439234] Call Trace: <4> [86.439236] <TASK> <4> [86.439240] ? lock_acquire+0xc4/0x2f0 <4> [86.439244] ? lock_release+0xd0/0x2b0 <4> [86.439249] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.439255] process_one_work+0x239/0x760 <4> [86.439261] worker_thread+0x200/0x3f0 <4> [86.439263] ? __pfx_worker_thread+0x10/0x10 <4> [86.439266] kthread+0x10d/0x150 <4> [86.439269] ? __pfx_kthread+0x10/0x10 <4> [86.439273] ret_from_fork+0x3d4/0x480 <4> [86.439275] ? __pfx_kthread+0x10/0x10 <4> [86.439278] ret_from_fork_asm+0x1a/0x30 <4> [86.439285] </TASK> <4> [86.439287] irq event stamp: 323887 <4> [86.439288] hardirqs last enabled at (323893): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.439291] hardirqs last disabled at (323898): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.439293] softirqs last enabled at (320238): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.439295] softirqs last disabled at (320231): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.439298] ---[ end trace 0000000000000000 ]--- <7> [86.439311] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [86.439416] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [86.439512] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.439584] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.439590] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.439831] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.440038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.440130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.440237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.440326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.440415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.440503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.440591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.440680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.440762] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.440856] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.440973] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.441980] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.452165] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.452416] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.453419] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.453499] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.453575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.453652] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.453728] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.453803] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.453878] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.453954] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.454031] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.454108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.454234] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.454310] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.454385] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.454459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.454533] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.454608] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.454681] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.454755] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.454828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.454910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.454992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.455071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.455151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.455246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.455326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.455407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.455488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.455567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.455648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.455727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.455806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.455886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.455970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.456054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.456138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.456240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.456325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.456406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.456486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.456562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.456642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.456720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.456800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.456879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.456960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.457037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.457115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.457205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.457283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.457359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.457435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.457514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.457590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.457666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.457742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.457820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.457899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.457978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.458058] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.458176] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.458182] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3039, lrc_seqno=3039, guc_id=0, flags=0x73 in no process [-1] <7> [86.458184] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.458243] ------------[ cut here ]------------ <4> [86.458245] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.458246] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#0: kworker/u64:5/204 <4> [86.458317] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.458381] efi_pstore nfnetlink autofs4 <4> [86.458385] CPU: 0 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.458388] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.458389] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.458390] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.458395] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.458465] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.458467] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [86.458469] RAX: ffffffffa120354b RBX: ffff888174698f40 RCX: 0000000000000000 <4> [86.458471] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.458472] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.458473] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.458474] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.458476] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [86.458477] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.458478] CR2: 00007724b3cbd4b0 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.458480] PKRU: 55555554 <4> [86.458481] Call Trace: <4> [86.458482] <TASK> <4> [86.458486] ? lock_acquire+0xc4/0x2f0 <4> [86.458491] ? lock_release+0xd0/0x2b0 <4> [86.458496] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.458502] process_one_work+0x239/0x760 <4> [86.458508] worker_thread+0x200/0x3f0 <4> [86.458510] ? __pfx_worker_thread+0x10/0x10 <4> [86.458513] kthread+0x10d/0x150 <4> [86.458515] ? __pfx_kthread+0x10/0x10 <4> [86.458519] ret_from_fork+0x3d4/0x480 <4> [86.458521] ? __pfx_kthread+0x10/0x10 <4> [86.458524] ret_from_fork_asm+0x1a/0x30 <4> [86.458532] </TASK> <4> [86.458533] irq event stamp: 341335 <4> [86.458534] hardirqs last enabled at (341341): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.458537] hardirqs last disabled at (341346): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.458539] softirqs last enabled at (340534): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.458541] softirqs last disabled at (340527): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.458543] ---[ end trace 0000000000000000 ]--- <6> [86.458545] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.458615] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.458621] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.459859] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [86.459978] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [86.460082] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.460296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.460388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.460483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.460572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.460660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.460745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.460831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.460918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.461001] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.461094] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.461222] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.462243] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.472162] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.472411] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.473414] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.473496] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.473572] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.473650] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.473726] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.473804] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.473882] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.473958] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.474032] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.474107] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.474193] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.474276] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.474349] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.474423] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.474496] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.474568] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.474641] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.474713] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.474787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.474869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.474950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.475031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.475113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.475205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.475293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.475370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.475447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.475530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.475611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.475691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.475770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.475849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.475932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.476016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.476102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.476195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.476288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.476370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.476450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.476527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.476608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.476685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.476762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.476843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.476927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.477008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.477088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.477174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.477262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.477339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.477416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.477495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.477573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.477650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.477726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.477804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.477880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.477956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.478035] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.478148] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.478166] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3039, lrc_seqno=3039, guc_id=0, flags=0x73 in no process [-1] <7> [86.478169] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.478254] ------------[ cut here ]------------ <4> [86.478255] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.478257] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#4: kworker/u64:0/12 <4> [86.478357] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.478428] efi_pstore nfnetlink autofs4 <4> [86.478432] CPU: 4 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.478435] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.478437] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.478439] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.478445] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.478521] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.478523] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [86.478525] RAX: ffffffffa120354b RBX: ffff888174698f40 RCX: 0000000000000000 <4> [86.478526] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.478527] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.478529] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.478530] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.478532] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [86.478533] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.478534] CR2: 000071186c9e62f4 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.478536] PKRU: 55555554 <4> [86.478537] Call Trace: <4> [86.478538] <TASK> <4> [86.478542] ? lock_acquire+0xc4/0x2f0 <4> [86.478547] ? lock_release+0xd0/0x2b0 <4> [86.478552] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.478558] process_one_work+0x239/0x760 <4> [86.478565] worker_thread+0x200/0x3f0 <4> [86.478567] ? __pfx_worker_thread+0x10/0x10 <4> [86.478570] kthread+0x10d/0x150 <4> [86.478573] ? __pfx_kthread+0x10/0x10 <4> [86.478576] ret_from_fork+0x3d4/0x480 <4> [86.478579] ? __pfx_kthread+0x10/0x10 <4> [86.478582] ret_from_fork_asm+0x1a/0x30 <4> [86.478590] </TASK> <4> [86.478592] irq event stamp: 1139015 <4> [86.478593] hardirqs last enabled at (1139021): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.478596] hardirqs last disabled at (1139026): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.478599] softirqs last enabled at (1138096): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.478602] softirqs last disabled at (1138089): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.478604] ---[ end trace 0000000000000000 ]--- <7> [86.479135] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [86.479251] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [86.479806] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3094, lrc_seqno=3094, guc_id=0, flags=0x73 in no process [-1] <7> [86.479808] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.479868] ------------[ cut here ]------------ <4> [86.479870] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.479871] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#4: kworker/u64:0/12 <4> [86.479942] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.480005] efi_pstore nfnetlink autofs4 <4> [86.480009] CPU: 4 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.480011] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.480012] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.480014] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.480018] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.480090] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.480091] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [86.480093] RAX: ffffffffa120354b RBX: ffff888174729540 RCX: 0000000000000000 <4> [86.480095] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.480096] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.480097] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.480098] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.480100] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [86.480101] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.480102] CR2: 000071186c9e62f4 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.480104] PKRU: 55555554 <4> [86.480105] Call Trace: <4> [86.480106] <TASK> <4> [86.480110] ? lock_acquire+0xc4/0x2f0 <4> [86.480114] ? lock_release+0xd0/0x2b0 <4> [86.480119] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.480125] process_one_work+0x239/0x760 <4> [86.480131] worker_thread+0x200/0x3f0 <4> [86.480134] ? __pfx_worker_thread+0x10/0x10 <4> [86.480136] kthread+0x10d/0x150 <4> [86.480139] ? __pfx_kthread+0x10/0x10 <4> [86.480142] ret_from_fork+0x3d4/0x480 <4> [86.480144] ? __pfx_kthread+0x10/0x10 <4> [86.480147] ret_from_fork_asm+0x1a/0x30 <4> [86.480161] </TASK> <4> [86.480162] irq event stamp: 1142847 <4> [86.480163] hardirqs last enabled at (1142853): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.480166] hardirqs last disabled at (1142858): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.480168] softirqs last enabled at (1142836): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.480171] softirqs last disabled at (1142831): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.480173] ---[ end trace 0000000000000000 ]--- <6> [86.480175] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.480245] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.480251] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.480490] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.480693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.480782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.480875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.480961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.481049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.481138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.481240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.481328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.481411] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.481507] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.481626] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.482634] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.493154] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.493404] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.494397] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.494479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.494556] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.494633] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.494709] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.494784] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.494859] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.494932] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.495006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.495080] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.495157] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.495232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.495308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.495384] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.495459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.495533] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.495607] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.495681] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.495754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.495835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.495917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.495998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.496078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.496159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.496235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.496312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.496389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.496468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.496548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.496627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.496706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.496783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.496867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.496955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.497042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.497124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.497213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.497291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.497370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.497445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.497524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.497602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.497679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.497756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.497840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.497920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.497999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.498077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.498158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.498235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.498312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.498391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.498468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.498549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.498628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.498707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.498784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.498861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.498941] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.499052] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.499056] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3094, lrc_seqno=3094, guc_id=0, flags=0x73 in no process [-1] <7> [86.499058] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.499117] ------------[ cut here ]------------ <4> [86.499118] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.499120] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#4: kworker/u64:0/12 <4> [86.499200] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.499264] efi_pstore nfnetlink autofs4 <4> [86.499269] CPU: 4 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.499271] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.499273] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.499274] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.499279] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.499349] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.499351] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [86.499353] RAX: ffffffffa120354b RBX: ffff888174729540 RCX: 0000000000000000 <4> [86.499355] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.499356] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.499357] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.499358] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.499359] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [86.499361] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.499362] CR2: 000071186c9e62f4 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.499364] PKRU: 55555554 <4> [86.499365] Call Trace: <4> [86.499366] <TASK> <4> [86.499370] ? lock_acquire+0xc4/0x2f0 <4> [86.499375] ? lock_release+0xd0/0x2b0 <4> [86.499380] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.499386] process_one_work+0x239/0x760 <4> [86.499391] worker_thread+0x200/0x3f0 <4> [86.499394] ? __pfx_worker_thread+0x10/0x10 <4> [86.499396] kthread+0x10d/0x150 <4> [86.499399] ? __pfx_kthread+0x10/0x10 <4> [86.499403] ret_from_fork+0x3d4/0x480 <4> [86.499405] ? __pfx_kthread+0x10/0x10 <4> [86.499408] ret_from_fork_asm+0x1a/0x30 <4> [86.499416] </TASK> <4> [86.499417] irq event stamp: 1145925 <4> [86.499418] hardirqs last enabled at (1145931): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.499421] hardirqs last disabled at (1145936): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.499423] softirqs last enabled at (1144728): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.499425] softirqs last disabled at (1144719): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.499427] ---[ end trace 0000000000000000 ]--- <6> [86.500349] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.500422] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.500432] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.500485] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [86.500586] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [86.500939] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.501150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.501242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.501337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.501426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.501513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.501599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.501685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.501773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.501855] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.501951] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.502070] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.503078] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.513150] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.513401] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.514415] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.514494] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.514569] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.514647] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.514724] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.514799] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.514877] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.514955] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.515032] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.515107] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.515190] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.515268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.515343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.515419] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.515493] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.515567] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.515641] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.515715] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.515788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.515868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.515949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.516031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.516112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.516199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.516279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.516360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.516439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.516520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.516600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.516678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.516758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.516837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.516922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.517006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.517089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.517175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.517253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.517332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.517408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.517484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.517563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.517643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.517723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.517802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.517883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.517960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.518037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.518114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.518206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.518282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.518356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.518435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.518516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.518596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.518673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.518752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.518828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.518904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.518983] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.519094] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.519098] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3094, lrc_seqno=3094, guc_id=0, flags=0x73 in no process [-1] <7> [86.519100] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.519170] ------------[ cut here ]------------ <4> [86.519171] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.519173] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#4: kworker/u64:0/12 <4> [86.519243] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.519307] efi_pstore nfnetlink autofs4 <4> [86.519311] CPU: 4 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.519314] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.519315] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.519316] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.519322] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.519392] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.519393] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [86.519396] RAX: ffffffffa120354b RBX: ffff888174729540 RCX: 0000000000000000 <4> [86.519397] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.519398] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.519399] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.519401] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.519402] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [86.519404] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.519405] CR2: 000071186c9e62f4 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.519406] PKRU: 55555554 <4> [86.519408] Call Trace: <4> [86.519409] <TASK> <4> [86.519413] ? lock_acquire+0xc4/0x2f0 <4> [86.519417] ? lock_release+0xd0/0x2b0 <4> [86.519423] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.519428] process_one_work+0x239/0x760 <4> [86.519434] worker_thread+0x200/0x3f0 <4> [86.519437] ? __pfx_worker_thread+0x10/0x10 <4> [86.519439] kthread+0x10d/0x150 <4> [86.519442] ? __pfx_kthread+0x10/0x10 <4> [86.519446] ret_from_fork+0x3d4/0x480 <4> [86.519448] ? __pfx_kthread+0x10/0x10 <4> [86.519451] ret_from_fork_asm+0x1a/0x30 <4> [86.519458] </TASK> <4> [86.519459] irq event stamp: 1149079 <4> [86.519460] hardirqs last enabled at (1149085): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.519463] hardirqs last disabled at (1149090): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.519466] softirqs last enabled at (1148318): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.519468] softirqs last disabled at (1148311): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.519470] ---[ end trace 0000000000000000 ]--- <5> [86.520914] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3149, lrc_seqno=3149, guc_id=0, flags=0x73 in no process [-1] <7> [86.520917] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.520977] ------------[ cut here ]------------ <4> [86.520978] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.520979] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#4: kworker/u64:0/12 <4> [86.521049] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.521111] efi_pstore nfnetlink autofs4 <4> [86.521115] CPU: 4 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.521118] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.521119] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.521120] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.521125] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.521207] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.521209] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [86.521211] RAX: ffffffffa120354b RBX: ffff8881747bbc40 RCX: 0000000000000000 <4> [86.521213] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.521214] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.521215] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.521217] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.521218] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [86.521219] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.521221] CR2: 000071186c9e62f4 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.521222] PKRU: 55555554 <4> [86.521223] Call Trace: <4> [86.521224] <TASK> <4> [86.521228] ? lock_acquire+0xc4/0x2f0 <4> [86.521233] ? lock_release+0xd0/0x2b0 <4> [86.521238] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.521244] process_one_work+0x239/0x760 <4> [86.521250] worker_thread+0x200/0x3f0 <4> [86.521253] ? __pfx_worker_thread+0x10/0x10 <4> [86.521255] kthread+0x10d/0x150 <4> [86.521258] ? __pfx_kthread+0x10/0x10 <4> [86.521262] ret_from_fork+0x3d4/0x480 <4> [86.521264] ? __pfx_kthread+0x10/0x10 <4> [86.521267] ret_from_fork_asm+0x1a/0x30 <4> [86.521275] </TASK> <4> [86.521276] irq event stamp: 1151713 <4> [86.521277] hardirqs last enabled at (1151719): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.521280] hardirqs last disabled at (1151724): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.521282] softirqs last enabled at (1148318): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.521285] softirqs last disabled at (1148311): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.521287] ---[ end trace 0000000000000000 ]--- <7> [86.521300] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [86.521406] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [86.521503] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.521575] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.521581] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.521627] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.521831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.521920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.522013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.522104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.522202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.522290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.522377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.522465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.522547] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.522641] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.522758] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.523764] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.534144] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.534395] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.535423] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.535504] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.535581] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.535657] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.535734] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.535808] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.535884] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.535959] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.536033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.536107] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.536191] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.536268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.536346] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.536422] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.536498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.536573] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.536647] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.536720] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.536795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.536880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.536963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.537041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.537121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.537209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.537286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.537365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.537443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.537525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.537606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.537683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.537762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.537840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.537924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.538007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.538090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.538176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.538255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.538336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.538415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.538494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.538573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.538651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.538728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.538805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.538891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.538971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.539050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.539126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.539216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.539292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.539368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.539446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.539523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.539600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.539676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.539755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.539833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.539909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.539989] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.540099] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.540103] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3149, lrc_seqno=3149, guc_id=0, flags=0x73 in no process [-1] <7> [86.540105] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.541295] ------------[ cut here ]------------ <4> [86.541297] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.541298] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#4: kworker/u64:0/12 <4> [86.541373] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.541437] efi_pstore nfnetlink autofs4 <4> [86.541442] CPU: 4 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.541445] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.541446] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.541447] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.541452] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.541522] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.541524] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [86.541526] RAX: ffffffffa120354b RBX: ffff8881747bbc40 RCX: 0000000000000000 <4> [86.541528] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.541529] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.541530] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.541531] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.541533] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [86.541534] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.541536] CR2: 000071186c9e62f4 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.541537] PKRU: 55555554 <4> [86.541538] Call Trace: <4> [86.541539] <TASK> <4> [86.541543] ? lock_acquire+0xc4/0x2f0 <4> [86.541548] ? lock_release+0xd0/0x2b0 <4> [86.541553] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.541558] process_one_work+0x239/0x760 <4> [86.541565] worker_thread+0x200/0x3f0 <4> [86.541567] ? __pfx_worker_thread+0x10/0x10 <4> [86.541570] kthread+0x10d/0x150 <4> [86.541572] ? __pfx_kthread+0x10/0x10 <4> [86.541576] ret_from_fork+0x3d4/0x480 <4> [86.541578] ? __pfx_kthread+0x10/0x10 <4> [86.541581] ret_from_fork_asm+0x1a/0x30 <4> [86.541589] </TASK> <4> [86.541590] irq event stamp: 1154811 <4> [86.541591] hardirqs last enabled at (1154817): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.541594] hardirqs last disabled at (1154822): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.541596] softirqs last enabled at (1153710): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.541598] softirqs last disabled at (1153705): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.541600] ---[ end trace 0000000000000000 ]--- <6> [86.541602] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.541673] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.541679] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.541693] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [86.541797] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [86.542087] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.542322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.542415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.542511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.542601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.542692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.542780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.542865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.542954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.543036] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.543132] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.543267] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.544274] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.554140] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.554391] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.555390] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.555470] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.555547] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.555624] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.555701] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.555776] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.555851] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.555927] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.556001] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.556076] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.556162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.556240] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.556317] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.556392] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.556467] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.556541] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.556616] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.556689] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.556764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.556846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.556928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.557011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.557095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.557188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.557267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.557345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.557422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.557501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.557581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.557659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.557737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.557816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.557903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.557992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.558078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.558166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.558247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.558325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.558404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.558480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.558563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.558645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.558723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.558800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.558881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.558958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.559034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.559111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.559202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.559278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.559354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.559438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.559518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.559597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.559673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.559751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.559826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.559902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.559981] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.560091] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.560095] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3149, lrc_seqno=3149, guc_id=0, flags=0x73 in no process [-1] <7> [86.560098] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.560168] ------------[ cut here ]------------ <4> [86.560169] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.560171] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#0: kworker/u64:5/204 <4> [86.560242] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.560307] efi_pstore nfnetlink autofs4 <4> [86.560312] CPU: 0 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.560315] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.560316] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.560317] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.560323] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.560393] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.560395] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [86.560397] RAX: ffffffffa120354b RBX: ffff8881747bbc40 RCX: 0000000000000000 <4> [86.560399] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.560400] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.560401] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.560402] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.560404] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [86.560405] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.560407] CR2: 00007724b3cbd4b0 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.560408] PKRU: 55555554 <4> [86.560409] Call Trace: <4> [86.560411] <TASK> <4> [86.560415] ? lock_acquire+0xc4/0x2f0 <4> [86.560419] ? lock_release+0xd0/0x2b0 <4> [86.560424] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.560430] process_one_work+0x239/0x760 <4> [86.560436] worker_thread+0x200/0x3f0 <4> [86.560439] ? __pfx_worker_thread+0x10/0x10 <4> [86.560441] kthread+0x10d/0x150 <4> [86.560444] ? __pfx_kthread+0x10/0x10 <4> [86.560448] ret_from_fork+0x3d4/0x480 <4> [86.560450] ? __pfx_kthread+0x10/0x10 <4> [86.560453] ret_from_fork_asm+0x1a/0x30 <4> [86.560460] </TASK> <4> [86.560461] irq event stamp: 348201 <4> [86.560463] hardirqs last enabled at (348207): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.560465] hardirqs last disabled at (348212): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.560467] softirqs last enabled at (347104): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.560470] softirqs last disabled at (347099): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.560472] ---[ end trace 0000000000000000 ]--- <5> [86.561923] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3204, lrc_seqno=3204, guc_id=0, flags=0x73 in no process [-1] <7> [86.561925] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.561988] ------------[ cut here ]------------ <4> [86.561989] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.561990] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#0: kworker/u64:5/204 <4> [86.562064] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.562126] efi_pstore nfnetlink autofs4 <4> [86.562139] CPU: 0 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.562143] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.562144] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.562146] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.562151] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.562221] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.562223] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [86.562225] RAX: ffffffffa120354b RBX: ffff888174839840 RCX: 0000000000000000 <4> [86.562227] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.562228] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.562229] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.562231] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.562232] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [86.562233] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.562235] CR2: 00007724b3cbd4b0 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.562236] PKRU: 55555554 <4> [86.562238] Call Trace: <4> [86.562239] <TASK> <4> [86.562243] ? lock_acquire+0xc4/0x2f0 <4> [86.562247] ? lock_release+0xd0/0x2b0 <4> [86.562252] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.562258] process_one_work+0x239/0x760 <4> [86.562264] worker_thread+0x200/0x3f0 <4> [86.562266] ? __pfx_worker_thread+0x10/0x10 <4> [86.562269] kthread+0x10d/0x150 <4> [86.562272] ? __pfx_kthread+0x10/0x10 <4> [86.562275] ret_from_fork+0x3d4/0x480 <4> [86.562277] ? __pfx_kthread+0x10/0x10 <4> [86.562281] ret_from_fork_asm+0x1a/0x30 <4> [86.562288] </TASK> <4> [86.562289] irq event stamp: 350895 <4> [86.562290] hardirqs last enabled at (350901): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.562292] hardirqs last disabled at (350906): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.562294] softirqs last enabled at (350694): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.562297] softirqs last disabled at (350689): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.562299] ---[ end trace 0000000000000000 ]--- <7> [86.562312] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [86.562416] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [86.562515] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.562586] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.562592] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.562638] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.562841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.562929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.563022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.563112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.563217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.563305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.563391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.563478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.563560] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.563654] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.563769] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.564778] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.575135] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.575387] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.576416] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.576497] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.576574] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.576652] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.576728] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.576803] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.576879] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.576954] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.577029] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.577103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.577193] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.577271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.577347] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.577423] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.577498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.577572] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.577645] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.577720] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.577794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.577877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.577959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.578041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.578124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.578217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.578294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.578371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.578448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.578527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.578607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.578684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.578763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.578845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.578933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.579019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.579106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.579204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.579286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.579365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.579443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.579519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.579598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.579676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.579754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.579834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.579917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.579995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.580073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.580157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.580235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.580310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.580388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.580470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.580548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.580627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.580703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.580781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.580857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.580933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.581012] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.581285] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.581289] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3204, lrc_seqno=3204, guc_id=0, flags=0x73 in no process [-1] <7> [86.581292] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.581351] ------------[ cut here ]------------ <4> [86.581352] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.581354] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#0: kworker/u64:5/204 <4> [86.581426] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.581490] efi_pstore nfnetlink autofs4 <4> [86.581494] CPU: 0 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.581497] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.581498] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.581500] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.581504] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.581574] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.581575] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [86.581578] RAX: ffffffffa120354b RBX: ffff888174839840 RCX: 0000000000000000 <4> [86.581579] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.581580] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.581581] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.581582] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.581584] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [86.581585] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.581587] CR2: 00007724b3cbd4b0 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.581588] PKRU: 55555554 <4> [86.581589] Call Trace: <4> [86.581590] <TASK> <4> [86.581594] ? lock_acquire+0xc4/0x2f0 <4> [86.581599] ? lock_release+0xd0/0x2b0 <4> [86.581604] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.581609] process_one_work+0x239/0x760 <4> [86.581615] worker_thread+0x200/0x3f0 <4> [86.581618] ? __pfx_worker_thread+0x10/0x10 <4> [86.581620] kthread+0x10d/0x150 <4> [86.581623] ? __pfx_kthread+0x10/0x10 <4> [86.581627] ret_from_fork+0x3d4/0x480 <4> [86.581629] ? __pfx_kthread+0x10/0x10 <4> [86.581632] ret_from_fork_asm+0x1a/0x30 <4> [86.581639] </TASK> <4> [86.581640] irq event stamp: 353989 <4> [86.581641] hardirqs last enabled at (353995): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.581644] hardirqs last disabled at (354000): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.581646] softirqs last enabled at (352892): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.581649] softirqs last disabled at (352885): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.581651] ---[ end trace 0000000000000000 ]--- <6> [86.581653] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.581723] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.581728] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.582962] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [86.583067] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [86.583185] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.583391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.583482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.583578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.583667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.583754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.583839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.583924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.584010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.584092] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.584194] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.584312] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.585317] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.595135] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.595384] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.596406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.596484] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.596560] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.596635] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.596712] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.596788] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.596865] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.596943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.597019] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.597093] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.597176] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.597250] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.597324] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.597398] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.597472] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.597545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.597618] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.597690] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.597763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.597844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.597925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.598004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.598088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.598174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.598252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.598328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.598403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.598483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.598563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.598640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.598719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.598801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.598890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.598976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.599061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.599148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.599227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.599304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.599383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.599458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.599537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.599616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.599698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.599777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.599859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.599937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.600014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.600091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.600177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.600253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.600334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.600414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.600492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.600570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.600648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.600726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.600801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.600877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.600956] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.601066] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.601070] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3204, lrc_seqno=3204, guc_id=0, flags=0x73 in no process [-1] <7> [86.601073] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.601137] ------------[ cut here ]------------ <4> [86.601138] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.601140] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#4: kworker/u64:0/12 <4> [86.601211] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.601276] efi_pstore nfnetlink autofs4 <4> [86.601280] CPU: 4 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.601283] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.601284] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.601286] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.601291] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.601361] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.601363] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [86.601365] RAX: ffffffffa120354b RBX: ffff888174839840 RCX: 0000000000000000 <4> [86.601367] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.601368] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.601369] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.601370] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.601372] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [86.601373] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.601374] CR2: 000071186c9e62f4 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.601376] PKRU: 55555554 <4> [86.601377] Call Trace: <4> [86.601378] <TASK> <4> [86.601382] ? lock_acquire+0xc4/0x2f0 <4> [86.601387] ? lock_release+0xd0/0x2b0 <4> [86.601392] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.601398] process_one_work+0x239/0x760 <4> [86.601404] worker_thread+0x200/0x3f0 <4> [86.601407] ? __pfx_worker_thread+0x10/0x10 <4> [86.601409] kthread+0x10d/0x150 <4> [86.601412] ? __pfx_kthread+0x10/0x10 <4> [86.601415] ret_from_fork+0x3d4/0x480 <4> [86.601418] ? __pfx_kthread+0x10/0x10 <4> [86.601421] ret_from_fork_asm+0x1a/0x30 <4> [86.601428] </TASK> <4> [86.601429] irq event stamp: 1161007 <4> [86.601431] hardirqs last enabled at (1161013): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.601433] hardirqs last disabled at (1161018): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.601436] softirqs last enabled at (1160098): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.601438] softirqs last disabled at (1160091): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.601440] ---[ end trace 0000000000000000 ]--- <5> [86.602935] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3259, lrc_seqno=3259, guc_id=0, flags=0x73 in no process [-1] <7> [86.602938] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.603002] ------------[ cut here ]------------ <4> [86.603003] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.603004] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#4: kworker/u64:0/12 <4> [86.603074] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.603142] efi_pstore nfnetlink autofs4 <4> [86.603146] CPU: 4 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.603149] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.603150] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.603152] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.603157] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.603225] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.603227] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [86.603229] RAX: ffffffffa120354b RBX: ffff888174915140 RCX: 0000000000000000 <4> [86.603231] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.603232] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.603233] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.603235] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.603236] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [86.603238] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.603239] CR2: 000071186c9e62f4 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.603241] PKRU: 55555554 <4> [86.603242] Call Trace: <4> [86.603243] <TASK> <4> [86.603247] ? lock_acquire+0xc4/0x2f0 <4> [86.603251] ? lock_release+0xd0/0x2b0 <4> [86.603257] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.603262] process_one_work+0x239/0x760 <4> [86.603268] worker_thread+0x200/0x3f0 <4> [86.603271] ? __pfx_worker_thread+0x10/0x10 <4> [86.603274] kthread+0x10d/0x150 <4> [86.603277] ? __pfx_kthread+0x10/0x10 <4> [86.603280] ret_from_fork+0x3d4/0x480 <4> [86.603282] ? __pfx_kthread+0x10/0x10 <4> [86.603286] ret_from_fork_asm+0x1a/0x30 <4> [86.603293] </TASK> <4> [86.603294] irq event stamp: 1163737 <4> [86.603296] hardirqs last enabled at (1163743): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.603298] hardirqs last disabled at (1163748): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.603301] softirqs last enabled at (1160098): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.603303] softirqs last disabled at (1160091): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.603305] ---[ end trace 0000000000000000 ]--- <7> [86.603319] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [86.603421] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [86.603519] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.603593] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.603598] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.603645] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.603848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.603938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.604030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.604118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.604221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.604311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.604398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.604487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.604570] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.604664] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.604780] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.605788] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.616124] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.616375] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.617385] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.617465] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.617542] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.617619] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.617696] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.617771] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.617847] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.617921] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.617995] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.618069] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.618151] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.618225] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.618299] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.618374] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.618448] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.618522] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.618596] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.618670] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.618743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.618825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.618907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.618986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.619069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.619156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.619233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.619309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.619385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.619464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.619542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.619621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.619699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.619777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.619861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.619944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.620026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.620107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.620200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.620281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.620361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.620438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.620519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.620598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.620676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.620753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.620837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.620916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.620995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.621072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.621158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.621235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.621311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.621390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.621467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.621542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.621617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.621694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.621767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.621843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.621921] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.622032] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.622036] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3259, lrc_seqno=3259, guc_id=0, flags=0x73 in no process [-1] <7> [86.622038] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.622096] ------------[ cut here ]------------ <4> [86.622097] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.622098] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#4: kworker/u64:0/12 <4> [86.622180] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.622244] efi_pstore nfnetlink autofs4 <4> [86.622248] CPU: 4 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.622251] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.622252] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.622253] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.622258] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.622328] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.622330] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [86.622332] RAX: ffffffffa120354b RBX: ffff888174915140 RCX: 0000000000000000 <4> [86.622333] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.622335] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.622336] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.622337] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.622338] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [86.622340] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.622341] CR2: 000071186c9e62f4 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.622343] PKRU: 55555554 <4> [86.622344] Call Trace: <4> [86.622345] <TASK> <4> [86.622349] ? lock_acquire+0xc4/0x2f0 <4> [86.622353] ? lock_release+0xd0/0x2b0 <4> [86.622358] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.622364] process_one_work+0x239/0x760 <4> [86.622370] worker_thread+0x200/0x3f0 <4> [86.622373] ? __pfx_worker_thread+0x10/0x10 <4> [86.622375] kthread+0x10d/0x150 <4> [86.622378] ? __pfx_kthread+0x10/0x10 <4> [86.622381] ret_from_fork+0x3d4/0x480 <4> [86.622383] ? __pfx_kthread+0x10/0x10 <4> [86.622387] ret_from_fork_asm+0x1a/0x30 <4> [86.622394] </TASK> <4> [86.622395] irq event stamp: 1166811 <4> [86.622396] hardirqs last enabled at (1166817): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.622399] hardirqs last disabled at (1166822): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.622401] softirqs last enabled at (1165614): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.622403] softirqs last disabled at (1165609): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.622405] ---[ end trace 0000000000000000 ]--- <6> [86.623125] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.623261] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.623278] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.623421] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [86.623525] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [86.623630] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.623836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.623926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.624019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.624107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.624211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.624296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.624382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.624468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.624550] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.624646] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.624763] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.625882] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.636119] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.636370] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.637448] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.637529] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.637608] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.637687] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.637765] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.637842] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.637920] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.637997] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.638073] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.638187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.638261] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.638335] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.638408] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.638481] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.638556] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.638633] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.638709] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.638783] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.638858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.638939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.639020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.639099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.639192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.639269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.639350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.639429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.639506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.639587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.639667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.639746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.639825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.639904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.639988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.640076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.640173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.640256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.640338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.640415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.640492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.640569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.640654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.640735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.640814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.640892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.640973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.641051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.641136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.641215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.641295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.641371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.641446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.641525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.641603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.641683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.641760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.641839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.641914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.641990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.642068] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.642280] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.642285] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3259, lrc_seqno=3259, guc_id=0, flags=0x73 in no process [-1] <7> [86.642288] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.642347] ------------[ cut here ]------------ <4> [86.642348] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.642350] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#8: kworker/u64:0/12 <4> [86.642420] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.642486] efi_pstore nfnetlink autofs4 <4> [86.642491] CPU: 8 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.642494] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.642495] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.642496] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.642502] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.642572] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.642574] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [86.642576] RAX: ffffffffa120354b RBX: ffff888174915140 RCX: 0000000000000000 <4> [86.642577] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.642579] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.642580] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.642581] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.642583] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [86.642584] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.642585] CR2: 0000771c67e00088 CR3: 000000012322c002 CR4: 0000000000f72ef0 <4> [86.642587] PKRU: 55555554 <4> [86.642588] Call Trace: <4> [86.642589] <TASK> <4> [86.642594] ? lock_acquire+0xc4/0x2f0 <4> [86.642598] ? lock_release+0xd0/0x2b0 <4> [86.642604] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.642609] process_one_work+0x239/0x760 <4> [86.642615] worker_thread+0x200/0x3f0 <4> [86.642618] ? __pfx_worker_thread+0x10/0x10 <4> [86.642621] kthread+0x10d/0x150 <4> [86.642623] ? __pfx_kthread+0x10/0x10 <4> [86.642627] ret_from_fork+0x3d4/0x480 <4> [86.642629] ? __pfx_kthread+0x10/0x10 <4> [86.642632] ret_from_fork_asm+0x1a/0x30 <4> [86.642640] </TASK> <4> [86.642641] irq event stamp: 1170111 <4> [86.642642] hardirqs last enabled at (1170117): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.642645] hardirqs last disabled at (1170122): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.642647] softirqs last enabled at (1169008): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.642649] softirqs last disabled at (1169001): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.642652] ---[ end trace 0000000000000000 ]--- <5> [86.643243] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3314, lrc_seqno=3314, guc_id=0, flags=0x73 in no process [-1] <7> [86.643249] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.643439] ------------[ cut here ]------------ <4> [86.643443] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.643446] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#6: kworker/u64:5/204 <4> [86.643607] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.643741] efi_pstore nfnetlink autofs4 <4> [86.643750] CPU: 6 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.643755] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.643757] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.643759] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.643770] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.643943] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.643948] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [86.643953] RAX: ffffffffa120354b RBX: ffff88817499f540 RCX: 0000000000000000 <4> [86.643956] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.643958] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.643960] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.643962] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.643964] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [86.643967] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.643969] CR2: 00007bf32de0b048 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [86.643972] PKRU: 55555554 <4> [86.643974] Call Trace: <4> [86.643976] <TASK> <4> [86.643984] ? lock_acquire+0xc4/0x2f0 <4> [86.643992] ? lock_release+0xd0/0x2b0 <4> [86.644001] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.644011] process_one_work+0x239/0x760 <4> [86.644022] worker_thread+0x200/0x3f0 <4> [86.644027] ? __pfx_worker_thread+0x10/0x10 <4> [86.644031] kthread+0x10d/0x150 <4> [86.644036] ? __pfx_kthread+0x10/0x10 <4> [86.644042] ret_from_fork+0x3d4/0x480 <4> [86.644046] ? __pfx_kthread+0x10/0x10 <4> [86.644051] ret_from_fork_asm+0x1a/0x30 <4> [86.644064] </TASK> <4> [86.644066] irq event stamp: 356063 <4> [86.644068] hardirqs last enabled at (356069): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.644073] hardirqs last disabled at (356074): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.644076] softirqs last enabled at (355152): [<ffffffff8133ac13>] kernel_fpu_end+0x53/0x70 <4> [86.644080] softirqs last disabled at (355150): [<ffffffff8133b324>] kernel_fpu_begin_mask+0xc4/0x120 <4> [86.644084] ---[ end trace 0000000000000000 ]--- <6> [86.644088] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <7> [86.644165] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [86.644272] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [86.644372] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.644379] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.644454] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.644658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.644750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.644842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.644931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.645017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.645105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.645208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.645297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.645385] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.645483] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.645600] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.646608] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.657115] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.657364] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.658374] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.658453] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.658529] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.658608] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.658688] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.658766] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.658842] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.658916] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.658990] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.659065] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.659146] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.659220] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.659294] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.659370] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.659448] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.659525] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.659600] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.659674] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.659748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.659829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.659910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.659989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.660070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.660159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.660238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.660317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.660398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.660480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.660562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.660640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.660720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.660798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.660882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.660966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.661049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.661139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.661226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.661307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.661387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.661464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.661543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.661621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.661701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.661783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.661868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.661947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.662025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.662103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.662199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.662278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.662357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.662437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.662518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.662600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.662679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.662759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.662836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.662913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.662994] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.663110] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.663114] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3314, lrc_seqno=3314, guc_id=0, flags=0x73 in no process [-1] <7> [86.663116] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.663176] ------------[ cut here ]------------ <4> [86.663177] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.663179] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#8: kworker/u64:5/204 <4> [86.663251] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.663314] efi_pstore nfnetlink autofs4 <4> [86.663318] CPU: 8 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.663321] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.663322] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.663324] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.663329] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.663399] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.663401] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [86.663403] RAX: ffffffffa120354b RBX: ffff88817499f540 RCX: 0000000000000000 <4> [86.663405] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.663406] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.663407] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.663408] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.663410] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [86.663411] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.663413] CR2: 0000771c67e00088 CR3: 000000012322c002 CR4: 0000000000f72ef0 <4> [86.663414] PKRU: 55555554 <4> [86.663415] Call Trace: <4> [86.663416] <TASK> <4> [86.663420] ? lock_acquire+0xc4/0x2f0 <4> [86.663425] ? lock_release+0xd0/0x2b0 <4> [86.663430] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.663435] process_one_work+0x239/0x760 <4> [86.663441] worker_thread+0x200/0x3f0 <4> [86.663444] ? __pfx_worker_thread+0x10/0x10 <4> [86.663446] kthread+0x10d/0x150 <4> [86.663449] ? __pfx_kthread+0x10/0x10 <4> [86.663453] ret_from_fork+0x3d4/0x480 <4> [86.663455] ? __pfx_kthread+0x10/0x10 <4> [86.663458] ret_from_fork_asm+0x1a/0x30 <4> [86.663465] </TASK> <4> [86.663466] irq event stamp: 359171 <4> [86.663468] hardirqs last enabled at (359177): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.663470] hardirqs last disabled at (359182): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.663473] softirqs last enabled at (358262): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.663475] softirqs last disabled at (358255): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.663477] ---[ end trace 0000000000000000 ]--- <6> [86.663479] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.663549] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.663555] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.663967] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.664172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.664259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.664350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.664437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.664524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.664608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.664693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.664780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.664863] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.664960] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.665078] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.666092] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.676110] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.676359] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.677450] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.677530] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.677608] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.677685] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.677762] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.677837] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.677912] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.677986] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.678059] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.678145] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.678222] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.678298] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.678372] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.678445] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.678518] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.678592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.678665] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.678738] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.678810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.678889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.678971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.679052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.679142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.679220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.679297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.679374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.679450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.679529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.679610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.679692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.679772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.679852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.679936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.680021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.680108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.680188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.680267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.680344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.680421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.680499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.680584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.680666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.680747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.680826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.680909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.680986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.681063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.681147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.681225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.681304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.681385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.681465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.681542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.681620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.681697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.681775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.681850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.681926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.682005] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.682115] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.682119] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3314, lrc_seqno=3314, guc_id=0, flags=0x73 in no process [-1] <7> [86.682122] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.682180] ------------[ cut here ]------------ <4> [86.682181] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.682182] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#8: kworker/u64:5/204 <4> [86.682254] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.682317] efi_pstore nfnetlink autofs4 <4> [86.682321] CPU: 8 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.682324] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.682325] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.682326] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.682331] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.682401] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.682403] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [86.682405] RAX: ffffffffa120354b RBX: ffff88817499f540 RCX: 0000000000000000 <4> [86.682406] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.682407] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.682408] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.682410] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.682411] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [86.682412] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.682414] CR2: 0000771c67e00088 CR3: 000000012322c002 CR4: 0000000000f72ef0 <4> [86.682415] PKRU: 55555554 <4> [86.682416] Call Trace: <4> [86.682417] <TASK> <4> [86.682421] ? lock_acquire+0xc4/0x2f0 <4> [86.682425] ? lock_release+0xd0/0x2b0 <4> [86.682431] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.682436] process_one_work+0x239/0x760 <4> [86.682442] worker_thread+0x200/0x3f0 <4> [86.682445] ? __pfx_worker_thread+0x10/0x10 <4> [86.682447] kthread+0x10d/0x150 <4> [86.682450] ? __pfx_kthread+0x10/0x10 <4> [86.682453] ret_from_fork+0x3d4/0x480 <4> [86.682455] ? __pfx_kthread+0x10/0x10 <4> [86.682459] ret_from_fork_asm+0x1a/0x30 <4> [86.682466] </TASK> <4> [86.682467] irq event stamp: 362263 <4> [86.682468] hardirqs last enabled at (362269): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.682471] hardirqs last disabled at (362274): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.682473] softirqs last enabled at (361160): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.682475] softirqs last disabled at (361151): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.682478] ---[ end trace 0000000000000000 ]--- <5> [86.683074] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3369, lrc_seqno=3369, guc_id=0, flags=0x73 in no process [-1] <7> [86.683081] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.683342] ------------[ cut here ]------------ <4> [86.683344] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.683347] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#12: kworker/u64:1/120 <4> [86.683467] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.683569] efi_pstore nfnetlink autofs4 <4> [86.683576] CPU: 12 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.683580] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.683582] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.683584] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.683594] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.683709] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.683712] RSP: 0018:ffffc9000055bc98 EFLAGS: 00010246 <4> [86.683715] RAX: ffffffffa120354b RBX: ffff8881749ed440 RCX: 0000000000000000 <4> [86.683717] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.683719] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.683721] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.683723] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.683725] FS: 0000000000000000(0000) GS:ffff8888db297000(0000) knlGS:0000000000000000 <4> [86.683727] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.683730] CR2: 000075ce04098118 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [86.683732] PKRU: 55555554 <4> [86.683733] Call Trace: <4> [86.683735] <TASK> <4> [86.683742] ? lock_acquire+0xc4/0x2f0 <4> [86.683750] ? lock_release+0xd0/0x2b0 <4> [86.683759] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.683768] process_one_work+0x239/0x760 <4> [86.683778] worker_thread+0x200/0x3f0 <4> [86.683783] ? __pfx_worker_thread+0x10/0x10 <4> [86.683786] kthread+0x10d/0x150 <4> [86.683791] ? __pfx_kthread+0x10/0x10 <4> [86.683797] ret_from_fork+0x3d4/0x480 <4> [86.683799] ? __pfx_kthread+0x10/0x10 <4> [86.683804] ret_from_fork_asm+0x1a/0x30 <4> [86.683817] </TASK> <4> [86.683819] irq event stamp: 332963 <4> [86.683820] hardirqs last enabled at (332969): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.683825] hardirqs last disabled at (332974): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.683828] softirqs last enabled at (331088): [<ffffffff8133ac13>] kernel_fpu_end+0x53/0x70 <4> [86.683831] softirqs last disabled at (331086): [<ffffffff8133b324>] kernel_fpu_begin_mask+0xc4/0x120 <4> [86.683835] ---[ end trace 0000000000000000 ]--- <6> [86.683838] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.683955] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.683966] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.684057] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [86.684171] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [86.684278] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.684483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.684572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.684666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.684754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.684842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.684930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.685017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.685110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.685193] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.685287] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.685403] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.686410] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.697104] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.697352] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.698362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.698444] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.698520] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.698597] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.698673] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.698748] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.698822] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.698896] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.698970] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.699044] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.699122] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.699196] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.699269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.699342] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.699416] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.699492] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.699568] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.699642] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.699716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.699797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.699878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.699955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.700035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.700116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.700195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.700272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.700349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.700428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.700507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.700585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.700663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.700741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.700825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.700906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.700990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.701069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.701179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.701261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.701343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.701424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.701506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.701588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.701666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.701744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.701825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.701907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.701988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.702067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.702155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.702232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.702309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.702387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.702464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.702540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.702618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.702700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.702777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.702857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.702939] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.703048] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.703052] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3369, lrc_seqno=3369, guc_id=0, flags=0x73 in no process [-1] <7> [86.703055] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.703123] ------------[ cut here ]------------ <4> [86.703124] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.703125] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#8: kworker/u64:5/204 <4> [86.703197] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.703261] efi_pstore nfnetlink autofs4 <4> [86.703266] CPU: 8 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.703268] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.703269] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.703271] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.703276] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.703346] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.703347] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [86.703350] RAX: ffffffffa120354b RBX: ffff8881749ed440 RCX: 0000000000000000 <4> [86.703351] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.703352] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.703354] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.703355] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.703356] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [86.703358] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.703359] CR2: 0000771c67e00088 CR3: 000000012322c002 CR4: 0000000000f72ef0 <4> [86.703360] PKRU: 55555554 <4> [86.703361] Call Trace: <4> [86.703362] <TASK> <4> [86.703366] ? lock_acquire+0xc4/0x2f0 <4> [86.703371] ? lock_release+0xd0/0x2b0 <4> [86.703376] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.703382] process_one_work+0x239/0x760 <4> [86.703388] worker_thread+0x200/0x3f0 <4> [86.703391] ? __pfx_worker_thread+0x10/0x10 <4> [86.703393] kthread+0x10d/0x150 <4> [86.703396] ? __pfx_kthread+0x10/0x10 <4> [86.703399] ret_from_fork+0x3d4/0x480 <4> [86.703401] ? __pfx_kthread+0x10/0x10 <4> [86.703405] ret_from_fork_asm+0x1a/0x30 <4> [86.703412] </TASK> <4> [86.703413] irq event stamp: 367803 <4> [86.703414] hardirqs last enabled at (367809): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.703417] hardirqs last disabled at (367814): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.703419] softirqs last enabled at (366894): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.703422] softirqs last disabled at (366887): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.703424] ---[ end trace 0000000000000000 ]--- <6> [86.703426] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.703495] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.703501] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.703905] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.704111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.704199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.704293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.704379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.704467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.704552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.704639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.704726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.704811] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.704907] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.705024] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.706030] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.716754] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.717003] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.718033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.718115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.718192] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.718269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.718345] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.718422] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.718498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.718575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.718650] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.718725] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.718799] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.718872] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.718946] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.719019] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.719095] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.719168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.719242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.719315] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.719388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.719469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.719550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.719632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.719712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.719793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.719874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.719953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.720030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.720116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.720197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.720279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.720361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.720442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.720526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.720610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.720694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.720774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.720855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.720932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.721009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.721085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.721178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.721259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.721340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.721417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.721499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.721577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.721655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.721733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.721814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.721893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.721971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.722051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.722136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.722212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.722287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.722364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.722438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.722512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.722590] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.722698] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.722702] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3369, lrc_seqno=3369, guc_id=0, flags=0x73 in no process [-1] <7> [86.722704] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.722762] ------------[ cut here ]------------ <4> [86.722763] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.722765] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#8: kworker/u64:5/204 <4> [86.722835] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.722898] efi_pstore nfnetlink autofs4 <4> [86.722902] CPU: 8 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.722905] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.722906] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.722907] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.722912] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.722981] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.722983] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [86.722985] RAX: ffffffffa120354b RBX: ffff8881749ed440 RCX: 0000000000000000 <4> [86.722986] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.722987] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.722989] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.722990] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.722991] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [86.722993] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.722994] CR2: 0000771c67e00088 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.722996] PKRU: 55555554 <4> [86.722997] Call Trace: <4> [86.722998] <TASK> <4> [86.723002] ? lock_acquire+0xc4/0x2f0 <4> [86.723006] ? lock_release+0xd0/0x2b0 <4> [86.723011] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.723017] process_one_work+0x239/0x760 <4> [86.723023] worker_thread+0x200/0x3f0 <4> [86.723025] ? __pfx_worker_thread+0x10/0x10 <4> [86.723028] kthread+0x10d/0x150 <4> [86.723031] ? __pfx_kthread+0x10/0x10 <4> [86.723034] ret_from_fork+0x3d4/0x480 <4> [86.723036] ? __pfx_kthread+0x10/0x10 <4> [86.723040] ret_from_fork_asm+0x1a/0x30 <4> [86.723047] </TASK> <4> [86.723048] irq event stamp: 370901 <4> [86.723049] hardirqs last enabled at (370907): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.723052] hardirqs last disabled at (370912): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.723054] softirqs last enabled at (369830): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.723056] softirqs last disabled at (369823): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.723059] ---[ end trace 0000000000000000 ]--- <7> [86.724104] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [86.724211] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [86.724786] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3424, lrc_seqno=3424, guc_id=0, flags=0x73 in no process [-1] <7> [86.724793] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.724900] ------------[ cut here ]------------ <4> [86.724902] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.724904] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#13: kworker/u64:0/12 <4> [86.725022] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.725120] efi_pstore nfnetlink autofs4 <4> [86.725126] CPU: 13 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.725130] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.725132] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.725134] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.725142] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.725257] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.725259] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [86.725262] RAX: ffffffffa120354b RBX: ffff888174b38f40 RCX: 0000000000000000 <4> [86.725264] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.725266] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.725268] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.725270] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.725271] FS: 0000000000000000(0000) GS:ffff8888db317000(0000) knlGS:0000000000000000 <4> [86.725274] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.725276] CR2: 000075ce04096128 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [86.725278] PKRU: 55555554 <4> [86.725279] Call Trace: <4> [86.725281] <TASK> <4> [86.725288] ? lock_acquire+0xc4/0x2f0 <4> [86.725295] ? lock_release+0xd0/0x2b0 <4> [86.725303] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.725312] process_one_work+0x239/0x760 <4> [86.725322] worker_thread+0x200/0x3f0 <4> [86.725326] ? __pfx_worker_thread+0x10/0x10 <4> [86.725330] kthread+0x10d/0x150 <4> [86.725333] ? __pfx_kthread+0x10/0x10 <4> [86.725339] ret_from_fork+0x3d4/0x480 <4> [86.725341] ? __pfx_kthread+0x10/0x10 <4> [86.725346] ret_from_fork_asm+0x1a/0x30 <4> [86.725358] </TASK> <4> [86.725360] irq event stamp: 1175425 <4> [86.725362] hardirqs last enabled at (1175431): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.725366] hardirqs last disabled at (1175436): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.725369] softirqs last enabled at (1175072): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.725373] softirqs last disabled at (1175067): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.725376] ---[ end trace 0000000000000000 ]--- <6> [86.725379] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.725493] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.725501] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.725569] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.725822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.725957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.726115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.726250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.726383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.726514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.726647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.726781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.726911] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.727053] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.727226] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.728577] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.739108] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.739361] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.740362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.740442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.740514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.740588] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.740660] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.740757] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.740862] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.740966] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.741057] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.741143] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.741219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.741296] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.741372] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.741482] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.741596] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.741708] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.741822] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.741916] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.741993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.742078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.742178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.742257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.742373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.742528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.742648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.742733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.742813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.742895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.742977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.743074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.743228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.743349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.743464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.743554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.743641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.743723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.743803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.743882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.743997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.744119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.744243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.744347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.744430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.744508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.744590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.744668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.744747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.744827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.744909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.744988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.745067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.745217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.745333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.745455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.745562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.745644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.745722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.745799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.745883] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.746024] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.746031] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3424, lrc_seqno=3424, guc_id=0, flags=0x73 in no process [-1] <7> [86.746035] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.746153] ------------[ cut here ]------------ <4> [86.746156] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.746158] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#10: kworker/u64:0/12 <4> [86.746269] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.746365] efi_pstore nfnetlink autofs4 <4> [86.746369] CPU: 10 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.746372] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.746374] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.746375] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.746380] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.746451] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.746453] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [86.746455] RAX: ffffffffa120354b RBX: ffff888174b38f40 RCX: 0000000000000000 <4> [86.746457] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.746458] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.746459] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.746460] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.746462] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [86.746463] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.746465] CR2: 000075ce18fa8000 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [86.746466] PKRU: 55555554 <4> [86.746467] Call Trace: <4> [86.746468] <TASK> <4> [86.746473] ? lock_acquire+0xc4/0x2f0 <4> [86.746477] ? lock_release+0xd0/0x2b0 <4> [86.746483] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.746488] process_one_work+0x239/0x760 <4> [86.746494] worker_thread+0x200/0x3f0 <4> [86.746497] ? __pfx_worker_thread+0x10/0x10 <4> [86.746500] kthread+0x10d/0x150 <4> [86.746503] ? __pfx_kthread+0x10/0x10 <4> [86.746506] ret_from_fork+0x3d4/0x480 <4> [86.746508] ? __pfx_kthread+0x10/0x10 <4> [86.746512] ret_from_fork_asm+0x1a/0x30 <4> [86.746519] </TASK> <4> [86.746520] irq event stamp: 1178565 <4> [86.746521] hardirqs last enabled at (1178571): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.746524] hardirqs last disabled at (1178576): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.746526] softirqs last enabled at (1177592): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.746528] softirqs last disabled at (1177587): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.746531] ---[ end trace 0000000000000000 ]--- <6> [86.746533] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.746603] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.746609] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.747017] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.747503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.747597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.747701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.747828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.747958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.748069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.748178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.748270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.748356] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.748480] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.748668] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.749760] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.760449] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.760692] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.761747] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.761820] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.761891] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.761961] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.762032] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.762114] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.762229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.762345] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.762462] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.762540] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.762617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.762692] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.762768] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.762870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.762984] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.763102] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.763211] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.763288] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.763363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.763445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.763533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.763652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.763773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.763896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.764002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.764090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.764168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.764249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.764346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.764462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.764581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.764707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.764796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.764882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.764970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.765072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.765264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.765400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.765531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.765658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.765788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.765916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.766042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.766176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.766308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.766434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.766560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.766684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.766810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.766934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.767058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.767191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.767317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.767443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.767567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.767693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.767817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.767941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.768069] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.768291] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.768297] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3424, lrc_seqno=3424, guc_id=0, flags=0x73 in no process [-1] <7> [86.768299] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.768371] ------------[ cut here ]------------ <4> [86.768372] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.768374] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#6: kworker/u64:0/12 <4> [86.768452] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.768517] efi_pstore nfnetlink autofs4 <4> [86.768521] CPU: 6 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.768524] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.768525] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.768527] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.768532] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.768607] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.768609] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [86.768611] RAX: ffffffffa120354b RBX: ffff888174b38f40 RCX: 0000000000000000 <4> [86.768613] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.768614] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.768615] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.768616] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.768618] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [86.768619] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.768621] CR2: 00007bf32de0b048 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [86.768622] PKRU: 55555554 <4> [86.768623] Call Trace: <4> [86.768624] <TASK> <4> [86.768629] ? lock_acquire+0xc4/0x2f0 <4> [86.768634] ? lock_release+0xd0/0x2b0 <4> [86.768639] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.768645] process_one_work+0x239/0x760 <4> [86.768651] worker_thread+0x200/0x3f0 <4> [86.768654] ? __pfx_worker_thread+0x10/0x10 <4> [86.768656] kthread+0x10d/0x150 <4> [86.768659] ? __pfx_kthread+0x10/0x10 <4> [86.768663] ret_from_fork+0x3d4/0x480 <4> [86.768665] ? __pfx_kthread+0x10/0x10 <4> [86.768668] ret_from_fork_asm+0x1a/0x30 <4> [86.768675] </TASK> <4> [86.768677] irq event stamp: 1181709 <4> [86.768678] hardirqs last enabled at (1181715): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.768681] hardirqs last disabled at (1181720): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.768683] softirqs last enabled at (1180870): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.768685] softirqs last disabled at (1180859): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.768687] ---[ end trace 0000000000000000 ]--- <5> [86.769598] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3479, lrc_seqno=3479, guc_id=0, flags=0x73 in no process [-1] <7> [86.769604] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.769729] ------------[ cut here ]------------ <4> [86.769732] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.769734] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#12: kworker/u64:1/120 <4> [86.769848] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.769945] efi_pstore nfnetlink autofs4 <4> [86.769951] CPU: 12 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.769955] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.769957] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.769959] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.769966] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.770085] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.770088] RSP: 0018:ffffc9000055bc98 EFLAGS: 00010246 <4> [86.770091] RAX: ffffffffa120354b RBX: ffff888174b80c40 RCX: 0000000000000000 <4> [86.770093] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.770095] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.770097] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.770099] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.770100] FS: 0000000000000000(0000) GS:ffff8888db297000(0000) knlGS:0000000000000000 <4> [86.770103] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.770105] CR2: 000075ce04098118 CR3: 000000012bf77001 CR4: 0000000000f72ef0 <4> [86.770107] PKRU: 55555554 <7> [86.770034] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [86.770108] Call Trace: <4> [86.770110] <TASK> <4> [86.770116] ? lock_acquire+0xc4/0x2f0 <4> [86.770123] ? lock_release+0xd0/0x2b0 <4> [86.770131] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.770140] process_one_work+0x239/0x760 <4> [86.770150] worker_thread+0x200/0x3f0 <4> [86.770154] ? __pfx_worker_thread+0x10/0x10 <4> [86.770157] kthread+0x10d/0x150 <4> [86.770160] ? __pfx_kthread+0x10/0x10 <4> [86.770165] ret_from_fork+0x3d4/0x480 <4> [86.770167] ? __pfx_kthread+0x10/0x10 <4> [86.770172] ret_from_fork_asm+0x1a/0x30 <4> [86.770183] </TASK> <4> [86.770185] irq event stamp: 335047 <4> [86.770186] hardirqs last enabled at (335053): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.770189] hardirqs last disabled at (335058): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.770198] softirqs last enabled at (333470): [<ffffffff8133ac13>] kernel_fpu_end+0x53/0x70 <4> [86.770201] softirqs last disabled at (333468): [<ffffffff8133b324>] kernel_fpu_begin_mask+0xc4/0x120 <4> [86.770204] ---[ end trace 0000000000000000 ]--- <6> [86.770207] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <7> [86.770204] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [86.770320] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.770329] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.770378] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.770630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.770761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.770897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.771029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.771167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.771298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.771430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.771564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.771694] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.771836] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.772001] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.773320] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.784091] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.784402] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.785567] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.785688] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.785806] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.785927] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.786047] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.786174] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.786295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.786415] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.786535] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.786655] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.786775] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.786895] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.787015] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.787147] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.787230] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.787309] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.787388] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.787467] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.787544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.787628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.787710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.787791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.787872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.787951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.788032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.788122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.788200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.788280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.788360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.788439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.788518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.788597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.788682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.788766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.788850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.788931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.789011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.789091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.789170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.789251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.789334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.789416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.789496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.789575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.789656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.789733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.789811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.789887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.789966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.790042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.790126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.790205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.790282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.790359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.790439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.790523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.790603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.790681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.790762] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.790873] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.790877] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3479, lrc_seqno=3479, guc_id=0, flags=0x73 in no process [-1] <7> [86.790880] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.790938] ------------[ cut here ]------------ <4> [86.790939] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.790941] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#8: kworker/u64:1/120 <4> [86.791013] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.791080] efi_pstore nfnetlink autofs4 <4> [86.791085] CPU: 8 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.791088] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.791089] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.791091] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.791096] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.791166] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.791168] RSP: 0018:ffffc9000055bc98 EFLAGS: 00010246 <4> [86.791170] RAX: ffffffffa120354b RBX: ffff888174b80c40 RCX: 0000000000000000 <4> [86.791171] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.791172] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.791173] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.791175] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.791176] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [86.791178] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.791179] CR2: 0000771c67e00088 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.791180] PKRU: 55555554 <4> [86.791181] Call Trace: <4> [86.791182] <TASK> <4> [86.791186] ? lock_acquire+0xc4/0x2f0 <4> [86.791191] ? lock_release+0xd0/0x2b0 <4> [86.791196] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.791201] process_one_work+0x239/0x760 <4> [86.791207] worker_thread+0x200/0x3f0 <4> [86.791210] ? __pfx_worker_thread+0x10/0x10 <4> [86.791212] kthread+0x10d/0x150 <4> [86.791215] ? __pfx_kthread+0x10/0x10 <4> [86.791219] ret_from_fork+0x3d4/0x480 <4> [86.791221] ? __pfx_kthread+0x10/0x10 <4> [86.791224] ret_from_fork_asm+0x1a/0x30 <4> [86.791231] </TASK> <4> [86.791232] irq event stamp: 338137 <4> [86.791234] hardirqs last enabled at (338143): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.791236] hardirqs last disabled at (338148): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.791239] softirqs last enabled at (337894): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.791241] softirqs last disabled at (337889): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.791243] ---[ end trace 0000000000000000 ]--- <6> [86.792394] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.792467] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.792473] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.792528] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [86.792629] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [86.792736] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.792939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.793027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.793128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.793215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.793301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.793385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.793470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.793557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.793638] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.793733] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.793850] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.794857] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.805428] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.805678] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.806656] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.806734] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.806809] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.806887] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.806967] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.807045] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.807131] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.807206] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.807279] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.807353] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.807427] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.807500] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.807573] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.807646] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.807720] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.807793] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.807866] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.807939] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.808013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.808098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.808180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.808261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.808341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.808418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.808495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.808572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.808647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.808725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.808804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.808881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.808959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.809040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.809136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.809223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.809308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.809390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.809471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.809547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.809623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.809699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.809778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.809856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.809932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.810011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.810099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.810179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.810257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.810333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.810411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.810491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.810569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.810650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.810728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.810805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.810881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.810959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.811034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.811119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.811198] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.811308] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.811312] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3479, lrc_seqno=3479, guc_id=0, flags=0x73 in no process [-1] <7> [86.811314] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.811374] ------------[ cut here ]------------ <4> [86.811375] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.811376] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#8: kworker/u64:1/120 <4> [86.811448] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.811512] efi_pstore nfnetlink autofs4 <4> [86.811516] CPU: 8 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.811519] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.811520] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.811521] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.811526] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.811596] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.811598] RSP: 0018:ffffc9000055bc98 EFLAGS: 00010246 <4> [86.811600] RAX: ffffffffa120354b RBX: ffff888174b80c40 RCX: 0000000000000000 <4> [86.811602] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.811603] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.811604] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.811605] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.811607] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [86.811608] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.811609] CR2: 0000771c67e00088 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.811611] PKRU: 55555554 <4> [86.811612] Call Trace: <4> [86.811613] <TASK> <4> [86.811617] ? lock_acquire+0xc4/0x2f0 <4> [86.811621] ? lock_release+0xd0/0x2b0 <4> [86.811626] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.811632] process_one_work+0x239/0x760 <4> [86.811638] worker_thread+0x200/0x3f0 <4> [86.811641] ? __pfx_worker_thread+0x10/0x10 <4> [86.811643] kthread+0x10d/0x150 <4> [86.811646] ? __pfx_kthread+0x10/0x10 <4> [86.811649] ret_from_fork+0x3d4/0x480 <4> [86.811651] ? __pfx_kthread+0x10/0x10 <4> [86.811655] ret_from_fork_asm+0x1a/0x30 <4> [86.811662] </TASK> <4> [86.811663] irq event stamp: 341251 <4> [86.811664] hardirqs last enabled at (341257): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.811667] hardirqs last disabled at (341262): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.811669] softirqs last enabled at (340402): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.811671] softirqs last disabled at (340391): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.811674] ---[ end trace 0000000000000000 ]--- <5> [86.813060] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3534, lrc_seqno=3534, guc_id=0, flags=0x73 in no process [-1] <7> [86.813063] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [86.813181] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [86.813285] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [86.813383] ------------[ cut here ]------------ <4> [86.813384] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.813385] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#8: kworker/u64:1/120 <4> [86.813455] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.813518] efi_pstore nfnetlink autofs4 <4> [86.813522] CPU: 8 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.813525] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.813526] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.813527] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.813532] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.813600] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.813602] RSP: 0018:ffffc9000055bc98 EFLAGS: 00010246 <4> [86.813604] RAX: ffffffffa120354b RBX: ffff888174c01540 RCX: 0000000000000000 <4> [86.813605] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.813606] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.813607] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.813609] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.813610] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [86.813611] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.813613] CR2: 0000771c67e00088 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.813614] PKRU: 55555554 <4> [86.813615] Call Trace: <4> [86.813616] <TASK> <4> [86.813622] ? lock_acquire+0xc4/0x2f0 <4> [86.813626] ? lock_release+0xd0/0x2b0 <4> [86.813631] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.813637] process_one_work+0x239/0x760 <4> [86.813642] worker_thread+0x200/0x3f0 <4> [86.813645] ? __pfx_worker_thread+0x10/0x10 <4> [86.813648] kthread+0x10d/0x150 <4> [86.813650] ? __pfx_kthread+0x10/0x10 <4> [86.813654] ret_from_fork+0x3d4/0x480 <4> [86.813656] ? __pfx_kthread+0x10/0x10 <4> [86.813659] ret_from_fork_asm+0x1a/0x30 <4> [86.813667] </TASK> <4> [86.813668] irq event stamp: 343935 <4> [86.813669] hardirqs last enabled at (343941): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.813671] hardirqs last disabled at (343946): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.813674] softirqs last enabled at (343170): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.813676] softirqs last disabled at (343163): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.813678] ---[ end trace 0000000000000000 ]--- <6> [86.813680] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.813750] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.813755] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.813802] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.814006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.814121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.814215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.814304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.814390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.814475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.814565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.814656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.814742] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.814837] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.814954] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.815962] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.826072] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.826321] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.827296] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.827376] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.827454] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.827532] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.827607] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.827683] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.827758] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.827834] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.827910] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.827983] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.828057] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.828148] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.828221] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.828294] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.828367] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.828441] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.828514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.828587] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.828659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.828738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.828819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.828900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.828981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.829059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.829149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.829227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.829302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.829381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.829461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.829538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.829617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.829695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.829780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.829864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.829947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.830027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.830113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.830191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.830268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.830344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.830423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.830504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.830584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.830662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.830743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.830821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.830898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.830975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.831052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.831139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.831214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.831294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.831370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.831446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.831524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.831606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.831684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.831761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.831840] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.831949] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.831953] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3534, lrc_seqno=3534, guc_id=0, flags=0x73 in no process [-1] <7> [86.831955] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.832013] ------------[ cut here ]------------ <4> [86.832014] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.832015] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#8: kworker/u64:1/120 <4> [86.832091] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.832154] efi_pstore nfnetlink autofs4 <4> [86.832159] CPU: 8 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.832161] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.832162] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.832163] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.832168] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.832238] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.832239] RSP: 0018:ffffc9000055bc98 EFLAGS: 00010246 <4> [86.832241] RAX: ffffffffa120354b RBX: ffff888174c01540 RCX: 0000000000000000 <4> [86.832242] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.832244] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.832245] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.832246] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.832247] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [86.832249] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.832250] CR2: 0000771c67e00088 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.832252] PKRU: 55555554 <4> [86.832253] Call Trace: <4> [86.832254] <TASK> <4> [86.832258] ? lock_acquire+0xc4/0x2f0 <4> [86.832262] ? lock_release+0xd0/0x2b0 <4> [86.832267] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.832273] process_one_work+0x239/0x760 <4> [86.832279] worker_thread+0x200/0x3f0 <4> [86.832281] ? __pfx_worker_thread+0x10/0x10 <4> [86.832284] kthread+0x10d/0x150 <4> [86.832287] ? __pfx_kthread+0x10/0x10 <4> [86.832290] ret_from_fork+0x3d4/0x480 <4> [86.832292] ? __pfx_kthread+0x10/0x10 <4> [86.832296] ret_from_fork_asm+0x1a/0x30 <4> [86.832303] </TASK> <4> [86.832304] irq event stamp: 347023 <4> [86.832305] hardirqs last enabled at (347029): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.832308] hardirqs last disabled at (347034): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.832310] softirqs last enabled at (345932): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.832312] softirqs last disabled at (345925): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.832315] ---[ end trace 0000000000000000 ]--- <6> [86.832317] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.832385] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.832391] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.833621] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [86.833727] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [86.833833] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.834042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.834154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.834249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.834337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.834425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.834511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.834596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.834683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.834765] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.834860] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.834978] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.835976] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.846075] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.846325] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.847305] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.847384] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.847460] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.847538] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.847614] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.847689] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.847764] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.847839] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.847914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.847991] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.848072] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.848149] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.848224] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.848297] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.848371] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.848444] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.848517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.848594] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.848670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.848753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.848833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.848913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.848992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.849078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.849155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.849235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.849316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.849397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.849478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.849556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.849634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.849713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.849801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.849888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.849972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.850055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.850153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.850231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.850308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.850384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.850463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.850541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.850618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.850694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.850777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.850858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.850936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.851013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.851105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.851181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.851256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.851334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.851410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.851486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.851562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.851639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.851715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.851794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.851876] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.851988] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.851993] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3534, lrc_seqno=3534, guc_id=0, flags=0x73 in no process [-1] <7> [86.851995] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.852054] ------------[ cut here ]------------ <4> [86.852056] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.852057] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#0: kworker/u64:5/204 <4> [86.852147] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.852212] efi_pstore nfnetlink autofs4 <4> [86.852217] CPU: 0 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.852220] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.852221] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.852222] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.852227] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.852298] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.852299] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [86.852301] RAX: ffffffffa120354b RBX: ffff888174c01540 RCX: 0000000000000000 <4> [86.852303] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.852304] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.852306] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.852307] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.852308] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [86.852310] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.852311] CR2: 00007724b3cbd4b0 CR3: 000000012bf77005 CR4: 0000000000f72ef0 <4> [86.852313] PKRU: 55555554 <4> [86.852314] Call Trace: <4> [86.852315] <TASK> <4> [86.852319] ? lock_acquire+0xc4/0x2f0 <4> [86.852324] ? lock_release+0xd0/0x2b0 <4> [86.852329] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.852334] process_one_work+0x239/0x760 <4> [86.852341] worker_thread+0x200/0x3f0 <4> [86.852343] ? __pfx_worker_thread+0x10/0x10 <4> [86.852346] kthread+0x10d/0x150 <4> [86.852349] ? __pfx_kthread+0x10/0x10 <4> [86.852352] ret_from_fork+0x3d4/0x480 <4> [86.852354] ? __pfx_kthread+0x10/0x10 <4> [86.852357] ret_from_fork_asm+0x1a/0x30 <4> [86.852365] </TASK> <4> [86.852366] irq event stamp: 380565 <4> [86.852367] hardirqs last enabled at (380571): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.852370] hardirqs last disabled at (380576): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.852372] softirqs last enabled at (379822): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.852374] softirqs last disabled at (379817): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.852377] ---[ end trace 0000000000000000 ]--- <5> [86.853761] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3589, lrc_seqno=3589, guc_id=0, flags=0x73 in no process [-1] <7> [86.853764] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.853826] ------------[ cut here ]------------ <4> [86.853827] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.853829] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#0: kworker/u64:5/204 <4> [86.853901] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.853964] efi_pstore nfnetlink autofs4 <4> [86.853968] CPU: 0 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.853970] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.853971] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.853973] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.853977] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.854046] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.854047] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [86.854049] RAX: ffffffffa120354b RBX: ffff888174c95d40 RCX: 0000000000000000 <4> [86.854051] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.854052] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.854053] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.854054] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.854055] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [86.854057] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.854064] CR2: 00007724b3cbd4b0 CR3: 000000012bf77005 CR4: 0000000000f72ef0 <4> [86.854067] PKRU: 55555554 <4> [86.854069] Call Trace: <4> [86.854071] <TASK> <4> [86.854076] ? lock_acquire+0xc4/0x2f0 <4> [86.854080] ? lock_release+0xd0/0x2b0 <4> [86.854085] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.854091] process_one_work+0x239/0x760 <4> [86.854097] worker_thread+0x200/0x3f0 <4> [86.854100] ? __pfx_worker_thread+0x10/0x10 <4> [86.854102] kthread+0x10d/0x150 <4> [86.854105] ? __pfx_kthread+0x10/0x10 <4> [86.854109] ret_from_fork+0x3d4/0x480 <4> [86.854111] ? __pfx_kthread+0x10/0x10 <4> [86.854114] ret_from_fork_asm+0x1a/0x30 <4> [86.854122] </TASK> <4> [86.854123] irq event stamp: 383175 <4> [86.854124] hardirqs last enabled at (383181): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.854127] hardirqs last disabled at (383186): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.854129] softirqs last enabled at (379822): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.854131] softirqs last disabled at (379817): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.854134] ---[ end trace 0000000000000000 ]--- <7> [86.854148] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [86.854252] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [86.854350] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.854420] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.854426] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.854475] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.854683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.854776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.854870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.854960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.855048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.855148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.855238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.855327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.855410] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.855505] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.855619] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.856624] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.867063] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.867312] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.868302] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.868381] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.868457] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.868534] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.868611] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.868687] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.868761] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.868839] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.868916] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.868992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.869071] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.869145] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.869219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.869295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.869369] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.869443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.869516] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.869591] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.869664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.869747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.869831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.869910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.869990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.870072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.870150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.870226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.870303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.870382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.870462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.870539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.870619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.870702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.870788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.870873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.870958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.871039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.871130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.871208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.871289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.871370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.871452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.871532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.871610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.871687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.871767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.871843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.871920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.871996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.872076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.872151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.872227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.872310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.872390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.872468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.872545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.872625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.872704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.872782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.872863] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.872975] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.872979] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3589, lrc_seqno=3589, guc_id=0, flags=0x73 in no process [-1] <7> [86.872981] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.873039] ------------[ cut here ]------------ <4> [86.873040] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.873042] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#4: kworker/u64:0/12 <4> [86.873129] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.873193] efi_pstore nfnetlink autofs4 <4> [86.873198] CPU: 4 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.873201] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.873202] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.873203] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.873208] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.873279] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.873281] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [86.873283] RAX: ffffffffa120354b RBX: ffff888174c95d40 RCX: 0000000000000000 <4> [86.873285] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.873286] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.873287] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.873289] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.873290] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [86.873292] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.873293] CR2: 000071186c9e62f4 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.873295] PKRU: 55555554 <4> [86.873296] Call Trace: <4> [86.873297] <TASK> <4> [86.873302] ? lock_acquire+0xc4/0x2f0 <4> [86.873306] ? lock_release+0xd0/0x2b0 <4> [86.873311] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.873317] process_one_work+0x239/0x760 <4> [86.873323] worker_thread+0x200/0x3f0 <4> [86.873326] ? __pfx_worker_thread+0x10/0x10 <4> [86.873328] kthread+0x10d/0x150 <4> [86.873331] ? __pfx_kthread+0x10/0x10 <4> [86.873335] ret_from_fork+0x3d4/0x480 <4> [86.873337] ? __pfx_kthread+0x10/0x10 <4> [86.873340] ret_from_fork_asm+0x1a/0x30 <4> [86.873348] </TASK> <4> [86.873349] irq event stamp: 1190579 <4> [86.873350] hardirqs last enabled at (1190585): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.873353] hardirqs last disabled at (1190590): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.873355] softirqs last enabled at (1189836): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.873357] softirqs last disabled at (1189819): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.873359] ---[ end trace 0000000000000000 ]--- <6> [86.873361] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.873431] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.873437] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.873843] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.874044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.874145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.874237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.874323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.874412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.874500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.874586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.874673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.874754] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.874848] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.874963] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.875965] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.886686] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.886936] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.887961] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.888042] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.888133] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.888210] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.888287] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.888362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.888435] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.888510] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.888584] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.888658] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.888731] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.888806] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.888879] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.888952] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.889027] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.889110] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.889183] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.889256] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.889329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.889411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.889491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.889572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.889654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.889731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.889808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.889885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.889959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.890038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.890132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.890213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.890294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.890375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.890459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.890543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.890627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.890709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.890787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.890864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.890942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.891018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.891105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.891184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.891263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.891344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.891427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.891506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.891583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.891659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.891736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.891812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.891886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.891968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.892052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.892133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.892210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.892289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.892366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.892446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.892528] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.892638] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.892642] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3589, lrc_seqno=3589, guc_id=0, flags=0x73 in no process [-1] <7> [86.892644] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.892703] ------------[ cut here ]------------ <4> [86.892704] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.892705] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#4: kworker/u64:0/12 <4> [86.892776] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.892839] efi_pstore nfnetlink autofs4 <4> [86.892843] CPU: 4 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.892846] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.892847] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.892848] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.892853] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.892922] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.892923] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [86.892925] RAX: ffffffffa120354b RBX: ffff888174c95d40 RCX: 0000000000000000 <4> [86.892927] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.892928] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.892929] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.892930] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.892932] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [86.892933] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.892935] CR2: 000071186c9e62f4 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.892936] PKRU: 55555554 <4> [86.892937] Call Trace: <4> [86.892938] <TASK> <4> [86.892942] ? lock_acquire+0xc4/0x2f0 <4> [86.892947] ? lock_release+0xd0/0x2b0 <4> [86.892952] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.892957] process_one_work+0x239/0x760 <4> [86.892963] worker_thread+0x200/0x3f0 <4> [86.892966] ? __pfx_worker_thread+0x10/0x10 <4> [86.892968] kthread+0x10d/0x150 <4> [86.892971] ? __pfx_kthread+0x10/0x10 <4> [86.892975] ret_from_fork+0x3d4/0x480 <4> [86.892976] ? __pfx_kthread+0x10/0x10 <4> [86.892980] ret_from_fork_asm+0x1a/0x30 <4> [86.892987] </TASK> <4> [86.892988] irq event stamp: 1193669 <4> [86.892989] hardirqs last enabled at (1193675): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.892992] hardirqs last disabled at (1193680): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.892994] softirqs last enabled at (1192704): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.892997] softirqs last disabled at (1192699): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.892999] ---[ end trace 0000000000000000 ]--- <7> [86.894842] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [86.894950] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [86.895053] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3644, lrc_seqno=3644, guc_id=0, flags=0x73 in no process [-1] <7> [86.895056] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.895114] ------------[ cut here ]------------ <4> [86.895115] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.895117] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#4: kworker/u64:0/12 <4> [86.895186] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.895249] efi_pstore nfnetlink autofs4 <4> [86.895253] CPU: 4 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.895256] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.895257] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.895258] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.895263] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.895332] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.895333] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [86.895336] RAX: ffffffffa120354b RBX: ffff888174da6640 RCX: 0000000000000000 <4> [86.895337] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.895338] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.895339] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.895340] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.895342] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [86.895343] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.895345] CR2: 000071186c9e62f4 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.895346] PKRU: 55555554 <4> [86.895347] Call Trace: <4> [86.895348] <TASK> <4> [86.895352] ? lock_acquire+0xc4/0x2f0 <4> [86.895356] ? lock_release+0xd0/0x2b0 <4> [86.895361] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.895367] process_one_work+0x239/0x760 <4> [86.895373] worker_thread+0x200/0x3f0 <4> [86.895375] ? __pfx_worker_thread+0x10/0x10 <4> [86.895378] kthread+0x10d/0x150 <4> [86.895380] ? __pfx_kthread+0x10/0x10 <4> [86.895384] ret_from_fork+0x3d4/0x480 <4> [86.895386] ? __pfx_kthread+0x10/0x10 <4> [86.895389] ret_from_fork_asm+0x1a/0x30 <4> [86.895396] </TASK> <4> [86.895397] irq event stamp: 1196277 <4> [86.895398] hardirqs last enabled at (1196283): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.895401] hardirqs last disabled at (1196288): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.895403] softirqs last enabled at (1192704): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.895406] softirqs last disabled at (1192699): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.895408] ---[ end trace 0000000000000000 ]--- <6> [86.895410] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.895479] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.895485] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.895573] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.895776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.895864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.895957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.896044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.896146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.896231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.896317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.896405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.896487] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.896583] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.896700] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.897721] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.908053] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.908302] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.909319] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.909399] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.909476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.909552] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.909628] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.909704] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.909778] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.909852] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.909927] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.910000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.910083] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.910156] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.910229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.910303] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.910375] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.910449] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.910522] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.910596] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.910670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.910754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.910836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.910915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.910994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.911077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.911157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.911237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.911314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.911394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.911473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.911552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.911631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.911710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.911794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.911879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.911962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.912047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.912127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.912205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.912283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.912360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.912441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.912521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.912600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.912677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.912757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.912834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.912910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.912987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.913067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.913142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.913216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.913295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.913371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.913448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.913524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.913606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.913684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.913762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.913842] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.913952] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.913955] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3644, lrc_seqno=3644, guc_id=0, flags=0x73 in no process [-1] <7> [86.913958] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.914015] ------------[ cut here ]------------ <4> [86.914016] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.914018] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#4: kworker/u64:0/12 <4> [86.914097] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.914161] efi_pstore nfnetlink autofs4 <4> [86.914165] CPU: 4 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.914168] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.914169] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.914171] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.914176] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.914246] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.914247] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [86.914249] RAX: ffffffffa120354b RBX: ffff888174da6640 RCX: 0000000000000000 <4> [86.914251] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.914252] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.914253] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.914254] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.914256] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [86.914257] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.914259] CR2: 000071186c9e62f4 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.914260] PKRU: 55555554 <4> [86.914261] Call Trace: <4> [86.914262] <TASK> <4> [86.914266] ? lock_acquire+0xc4/0x2f0 <4> [86.914270] ? lock_release+0xd0/0x2b0 <4> [86.914276] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.914281] process_one_work+0x239/0x760 <4> [86.914287] worker_thread+0x200/0x3f0 <4> [86.914290] ? __pfx_worker_thread+0x10/0x10 <4> [86.914293] kthread+0x10d/0x150 <4> [86.914295] ? __pfx_kthread+0x10/0x10 <4> [86.914299] ret_from_fork+0x3d4/0x480 <4> [86.914301] ? __pfx_kthread+0x10/0x10 <4> [86.914304] ret_from_fork_asm+0x1a/0x30 <4> [86.914312] </TASK> <4> [86.914313] irq event stamp: 1199375 <4> [86.914314] hardirqs last enabled at (1199381): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.914317] hardirqs last disabled at (1199386): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.914319] softirqs last enabled at (1198466): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.914321] softirqs last disabled at (1198459): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.914323] ---[ end trace 0000000000000000 ]--- <6> [86.915075] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.915280] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.915288] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.915344] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [86.915448] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [86.915553] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.915759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.915847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.915940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.916029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.916132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.916217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.916303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.916388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.916469] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.916563] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.916678] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.917690] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.928402] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.928651] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.929685] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.929767] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.929844] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.929921] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.929996] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.930082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.930157] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.930231] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.930305] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.930379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.930454] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.930528] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.930604] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.930680] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.930755] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.930828] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.930902] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.930975] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.931054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.931134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.931216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.931299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.931381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.931458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.931533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.931609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.931684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.931762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.931840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.931918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.931999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.932090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.932176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.932263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.932351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.932434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.932515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.932594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.932672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.932750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.932829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.932910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.932990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.933080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.933163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.933240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.933318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.933396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.933477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.933555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.933632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.933711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.933788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.933865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.933940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.934018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.934102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.934177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.934260] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.934373] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.934378] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3644, lrc_seqno=3644, guc_id=0, flags=0x73 in no process [-1] <7> [86.934380] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.934440] ------------[ cut here ]------------ <4> [86.934441] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.934442] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#5: kworker/u64:0/12 <4> [86.934514] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.934579] efi_pstore nfnetlink autofs4 <4> [86.934584] CPU: 5 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.934586] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.934588] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.934589] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.934594] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.934665] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.934666] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [86.934668] RAX: ffffffffa120354b RBX: ffff888174da6640 RCX: 0000000000000000 <4> [86.934670] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.934671] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.934672] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.934673] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.934675] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000 <4> [86.934676] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.934677] CR2: 00005a59bd37a758 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [86.934679] PKRU: 55555554 <4> [86.934680] Call Trace: <4> [86.934681] <TASK> <4> [86.934686] ? lock_acquire+0xc4/0x2f0 <4> [86.934690] ? lock_release+0xd0/0x2b0 <4> [86.934696] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.934701] process_one_work+0x239/0x760 <4> [86.934708] worker_thread+0x200/0x3f0 <4> [86.934710] ? __pfx_worker_thread+0x10/0x10 <4> [86.934713] kthread+0x10d/0x150 <4> [86.934716] ? __pfx_kthread+0x10/0x10 <4> [86.934719] ret_from_fork+0x3d4/0x480 <4> [86.934721] ? __pfx_kthread+0x10/0x10 <4> [86.934724] ret_from_fork_asm+0x1a/0x30 <4> [86.934732] </TASK> <4> [86.934733] irq event stamp: 1202501 <4> [86.934734] hardirqs last enabled at (1202507): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.934737] hardirqs last disabled at (1202512): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.934739] softirqs last enabled at (1201646): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.934741] softirqs last disabled at (1201635): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.934743] ---[ end trace 0000000000000000 ]--- <5> [86.935370] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3699, lrc_seqno=3699, guc_id=0, flags=0x73 in no process [-1] <7> [86.935377] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.935484] ------------[ cut here ]------------ <4> [86.935485] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.935487] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#8: kworker/u64:1/120 <4> [86.935565] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.935636] efi_pstore nfnetlink autofs4 <4> [86.935641] CPU: 8 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.935646] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.935647] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.935649] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.935656] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.935734] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.935736] RSP: 0018:ffffc9000055bc98 EFLAGS: 00010246 <4> [86.935739] RAX: ffffffffa120354b RBX: ffff888174de8040 RCX: 0000000000000000 <4> [86.935740] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.935742] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.935744] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.935745] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.935747] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [86.935748] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.935750] CR2: 0000771c67e00088 CR3: 000000012bf77006 CR4: 0000000000f72ef0 <4> [86.935752] PKRU: 55555554 <4> [86.935754] Call Trace: <4> [86.935755] <TASK> <4> [86.935762] ? lock_acquire+0xc4/0x2f0 <4> [86.935768] ? lock_release+0xd0/0x2b0 <4> [86.935773] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.935779] process_one_work+0x239/0x760 <4> [86.935786] worker_thread+0x200/0x3f0 <4> [86.935789] ? __pfx_worker_thread+0x10/0x10 <4> [86.935792] kthread+0x10d/0x150 <4> [86.935795] ? __pfx_kthread+0x10/0x10 <4> [86.935799] ret_from_fork+0x3d4/0x480 <4> [86.935802] ? __pfx_kthread+0x10/0x10 <4> [86.935805] ret_from_fork_asm+0x1a/0x30 <4> [86.935814] </TASK> <4> [86.935816] irq event stamp: 351321 <4> [86.935818] hardirqs last enabled at (351327): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.935822] hardirqs last disabled at (351332): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.935825] softirqs last enabled at (349250): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.935828] softirqs last disabled at (349243): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.935830] ---[ end trace 0000000000000000 ]--- <6> [86.935833] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.935910] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.935920] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.936177] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [86.936282] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [86.936388] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.936592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.936684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.936777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.936864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.936951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.937034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.937135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.937221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.937304] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.937400] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.937517] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.938527] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.949042] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.949291] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.950257] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.950337] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.950413] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.950490] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.950565] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.950639] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.950712] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.950785] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.950857] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.950931] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.951009] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.951099] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.951176] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.951255] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.951332] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.951408] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.951483] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.951556] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.951631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.951714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.951796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.951875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.951955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.952030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.952121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.952197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.952274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.952352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.952432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.952510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.952588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.952668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.952757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.952844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.952930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.953012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.953100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.953178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.953255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.953332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.953412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.953493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.953573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.953652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.953734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.953812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.953891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.953967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.954047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.954122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.954199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.954278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.954355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.954431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.954506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.954583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.954658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.954733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.954817] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.954928] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.954932] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3699, lrc_seqno=3699, guc_id=0, flags=0x73 in no process [-1] <7> [86.954934] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.954992] ------------[ cut here ]------------ <4> [86.954993] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.954995] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#8: kworker/u64:1/120 <4> [86.955080] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.955143] efi_pstore nfnetlink autofs4 <4> [86.955148] CPU: 8 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.955150] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.955152] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.955153] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.955158] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.955227] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.955229] RSP: 0018:ffffc9000055bc98 EFLAGS: 00010246 <4> [86.955231] RAX: ffffffffa120354b RBX: ffff888174de8040 RCX: 0000000000000000 <4> [86.955232] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.955233] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.955235] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.955236] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.955237] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [86.955239] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.955240] CR2: 0000771c67e00088 CR3: 000000012bf77006 CR4: 0000000000f72ef0 <4> [86.955242] PKRU: 55555554 <4> [86.955243] Call Trace: <4> [86.955244] <TASK> <4> [86.955248] ? lock_acquire+0xc4/0x2f0 <4> [86.955252] ? lock_release+0xd0/0x2b0 <4> [86.955257] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.955263] process_one_work+0x239/0x760 <4> [86.955269] worker_thread+0x200/0x3f0 <4> [86.955272] ? __pfx_worker_thread+0x10/0x10 <4> [86.955274] kthread+0x10d/0x150 <4> [86.955277] ? __pfx_kthread+0x10/0x10 <4> [86.955280] ret_from_fork+0x3d4/0x480 <4> [86.955282] ? __pfx_kthread+0x10/0x10 <4> [86.955286] ret_from_fork_asm+0x1a/0x30 <4> [86.955293] </TASK> <4> [86.955294] irq event stamp: 354545 <4> [86.955295] hardirqs last enabled at (354551): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.955298] hardirqs last disabled at (354556): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.955300] softirqs last enabled at (353802): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.955303] softirqs last disabled at (353773): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.955305] ---[ end trace 0000000000000000 ]--- <6> [86.955307] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.955375] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.955381] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.955768] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.955969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.956060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.956151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.956238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.956328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.956416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.956503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.956590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.956671] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.956764] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.956881] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.957887] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.968608] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.968857] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.969866] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.969945] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.970021] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.970115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.970190] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.970265] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.970339] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.970414] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.970488] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.970561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.970634] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.970707] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.970780] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.970852] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.970928] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.971004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.971089] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.971166] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.971241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.971324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.971406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.971486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.971566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.971645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.971722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.971800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.971876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.971956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.972040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.972120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.972203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.972286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.972374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.972460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.972544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.972626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.972707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.972787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.972871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.972950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.973035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.973114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.973191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.973269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.973350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.973427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.973504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.973580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.973658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.973734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.973810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.973889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.973966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.974046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.974123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.974204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.974284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.974363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.974445] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.974557] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.974561] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3699, lrc_seqno=3699, guc_id=0, flags=0x73 in no process [-1] <7> [86.974563] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.974622] ------------[ cut here ]------------ <4> [86.974623] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.974624] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#8: kworker/u64:1/120 <4> [86.974696] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.974759] efi_pstore nfnetlink autofs4 <4> [86.974763] CPU: 8 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.974766] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.974767] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.974768] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.974773] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.974845] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.974847] RSP: 0018:ffffc9000055bc98 EFLAGS: 00010246 <4> [86.974849] RAX: ffffffffa120354b RBX: ffff888174de8040 RCX: 0000000000000000 <4> [86.974850] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.974851] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.974852] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.974854] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.974855] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [86.974856] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.974858] CR2: 0000771c67e00088 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.974859] PKRU: 55555554 <4> [86.974860] Call Trace: <4> [86.974861] <TASK> <4> [86.974866] ? lock_acquire+0xc4/0x2f0 <4> [86.974870] ? lock_release+0xd0/0x2b0 <4> [86.974875] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.974881] process_one_work+0x239/0x760 <4> [86.974887] worker_thread+0x200/0x3f0 <4> [86.974889] ? __pfx_worker_thread+0x10/0x10 <4> [86.974892] kthread+0x10d/0x150 <4> [86.974894] ? __pfx_kthread+0x10/0x10 <4> [86.974898] ret_from_fork+0x3d4/0x480 <4> [86.974900] ? __pfx_kthread+0x10/0x10 <4> [86.974903] ret_from_fork_asm+0x1a/0x30 <4> [86.974910] </TASK> <4> [86.974911] irq event stamp: 357641 <4> [86.974913] hardirqs last enabled at (357647): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.974915] hardirqs last disabled at (357652): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.974918] softirqs last enabled at (356576): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.974920] softirqs last disabled at (356569): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.974922] ---[ end trace 0000000000000000 ]--- <5> [86.976674] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3754, lrc_seqno=3754, guc_id=0, flags=0x73 in no process [-1] <7> [86.976677] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [86.976683] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [86.976740] ------------[ cut here ]------------ <4> [86.976741] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.976742] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#5: kworker/u64:0/12 <4> [86.976814] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp <7> [86.976789] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [86.976838] hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [86.976882] CPU: 5 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.976885] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.976886] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.976887] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.976892] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.976962] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.976964] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [86.976966] RAX: ffffffffa120354b RBX: ffff88810948da40 RCX: 0000000000000000 <4> [86.976967] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.976968] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.976970] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.976971] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.976972] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000 <4> [86.976974] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.976975] CR2: 00005a59bd37a758 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [86.976976] PKRU: 55555554 <4> [86.976977] Call Trace: <4> [86.976979] <TASK> <4> [86.976983] ? lock_acquire+0xc4/0x2f0 <4> [86.976987] ? lock_release+0xd0/0x2b0 <4> [86.976992] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.976997] process_one_work+0x239/0x760 <4> [86.977003] worker_thread+0x200/0x3f0 <4> [86.977006] ? __pfx_worker_thread+0x10/0x10 <4> [86.977009] kthread+0x10d/0x150 <4> [86.977011] ? __pfx_kthread+0x10/0x10 <4> [86.977015] ret_from_fork+0x3d4/0x480 <4> [86.977017] ? __pfx_kthread+0x10/0x10 <4> [86.977020] ret_from_fork_asm+0x1a/0x30 <4> [86.977034] </TASK> <4> [86.977035] irq event stamp: 1207071 <4> [86.977037] hardirqs last enabled at (1207077): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.977039] hardirqs last disabled at (1207082): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.977042] softirqs last enabled at (1207064): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.977044] softirqs last disabled at (1207055): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.977046] ---[ end trace 0000000000000000 ]--- <6> [86.977049] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.977119] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.977124] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.977171] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.977374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.977461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.977555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.977644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.977732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.977819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.977907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.977997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.978093] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.978189] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.978305] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.979311] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [86.989034] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [86.989281] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [86.990303] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [86.990383] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [86.990460] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [86.990536] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [86.990612] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [86.990687] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [86.990761] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [86.990835] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [86.990908] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [86.990982] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [86.991062] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [86.991136] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [86.991209] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [86.991283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [86.991356] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [86.991429] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [86.991502] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [86.991575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [86.991647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [86.991728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [86.991811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [86.991894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [86.991976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [86.992061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [86.992138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [86.992216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [86.992292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [86.992372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [86.992454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [86.992536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [86.992620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [86.992701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [86.992788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [86.992873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [86.992958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [86.993044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [86.993124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [86.993201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [86.993279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [86.993355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [86.993437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [86.993519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [86.993600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [86.993678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [86.993759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [86.993836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [86.993915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [86.993995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [86.994084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [86.994162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [86.994239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [86.994319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [86.994396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [86.994478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [86.994558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [86.994639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [86.994716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [86.994794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [86.994873] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [86.994983] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [86.994987] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3754, lrc_seqno=3754, guc_id=0, flags=0x73 in no process [-1] <7> [86.994989] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [86.995901] ------------[ cut here ]------------ <4> [86.995902] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [86.995903] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#8: kworker/u64:1/120 <4> [86.995977] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [86.996045] efi_pstore nfnetlink autofs4 <4> [86.996050] CPU: 8 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [86.996052] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [86.996054] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [86.996055] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [86.996060] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [86.996130] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [86.996131] RSP: 0018:ffffc9000055bc98 EFLAGS: 00010246 <4> [86.996134] RAX: ffffffffa120354b RBX: ffff88810948da40 RCX: 0000000000000000 <4> [86.996135] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [86.996136] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [86.996137] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [86.996139] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [86.996140] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [86.996141] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [86.996143] CR2: 0000771c67e00088 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [86.996144] PKRU: 55555554 <4> [86.996145] Call Trace: <4> [86.996146] <TASK> <4> [86.996150] ? lock_acquire+0xc4/0x2f0 <4> [86.996155] ? lock_release+0xd0/0x2b0 <4> [86.996160] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [86.996166] process_one_work+0x239/0x760 <4> [86.996172] worker_thread+0x200/0x3f0 <4> [86.996175] ? __pfx_worker_thread+0x10/0x10 <4> [86.996177] kthread+0x10d/0x150 <4> [86.996180] ? __pfx_kthread+0x10/0x10 <4> [86.996184] ret_from_fork+0x3d4/0x480 <4> [86.996186] ? __pfx_kthread+0x10/0x10 <4> [86.996189] ret_from_fork_asm+0x1a/0x30 <4> [86.996196] </TASK> <4> [86.996197] irq event stamp: 363021 <4> [86.996199] hardirqs last enabled at (363027): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [86.996201] hardirqs last disabled at (363032): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [86.996204] softirqs last enabled at (362012): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.996206] softirqs last disabled at (362003): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [86.996208] ---[ end trace 0000000000000000 ]--- <6> [86.996210] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [86.996279] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [86.996285] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [86.996299] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [86.996399] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [86.996674] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [86.996885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [86.996978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [86.997088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [86.997177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [86.997263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [86.997347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [86.997432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [86.997520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [86.997603] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [86.997700] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [86.997817] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [86.998825] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [87.009041] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [87.009291] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [87.010309] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [87.010388] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [87.010463] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [87.010540] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [87.010617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [87.010693] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [87.010766] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [87.010840] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [87.010915] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [87.010990] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [87.011080] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [87.011155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [87.011229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [87.011311] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [87.011428] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [87.011542] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [87.011642] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [87.011740] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [87.011838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [87.011945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [87.012060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [87.012163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [87.012262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [87.012346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [87.012426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [87.012504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [87.012580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [87.012659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [87.012739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [87.012819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [87.012901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [87.012981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [87.013080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [87.013166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [87.013250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [87.013331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [87.013411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [87.013489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [87.013567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [87.013643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [87.013723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [87.013802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [87.013884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [87.013965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [87.014059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [87.014140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [87.014221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [87.014302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [87.014382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [87.014460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [87.014537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [87.014618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [87.014696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [87.014774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [87.014850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [87.014930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [87.015010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [87.015105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [87.015188] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [87.015300] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [87.015305] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3754, lrc_seqno=3754, guc_id=0, flags=0x73 in no process [-1] <7> [87.015307] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.015367] ------------[ cut here ]------------ <4> [87.015368] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.015369] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#0: kworker/u64:5/204 <4> [87.015442] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.015508] efi_pstore nfnetlink autofs4 <4> [87.015512] CPU: 0 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.015515] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.015516] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.015518] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.015523] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.015592] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.015594] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [87.015596] RAX: ffffffffa120354b RBX: ffff88810948da40 RCX: 0000000000000000 <4> [87.015598] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.015599] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.015600] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.015601] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.015603] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [87.015605] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.015606] CR2: 00007724b3cbd4b0 CR3: 000000012bf77005 CR4: 0000000000f72ef0 <4> [87.015607] PKRU: 55555554 <4> [87.015608] Call Trace: <4> [87.015610] <TASK> <4> [87.015614] ? lock_acquire+0xc4/0x2f0 <4> [87.015618] ? lock_release+0xd0/0x2b0 <4> [87.015624] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.015629] process_one_work+0x239/0x760 <4> [87.015635] worker_thread+0x200/0x3f0 <4> [87.015638] ? __pfx_worker_thread+0x10/0x10 <4> [87.015640] kthread+0x10d/0x150 <4> [87.015643] ? __pfx_kthread+0x10/0x10 <4> [87.015647] ret_from_fork+0x3d4/0x480 <4> [87.015649] ? __pfx_kthread+0x10/0x10 <4> [87.015652] ret_from_fork_asm+0x1a/0x30 <4> [87.015660] </TASK> <4> [87.015661] irq event stamp: 390489 <4> [87.015662] hardirqs last enabled at (390495): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.015665] hardirqs last disabled at (390500): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.015667] softirqs last enabled at (389640): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.015669] softirqs last disabled at (389625): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.015672] ---[ end trace 0000000000000000 ]--- <5> [87.017039] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3809, lrc_seqno=3809, guc_id=0, flags=0x73 in no process [-1] <7> [87.017041] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.017102] ------------[ cut here ]------------ <4> [87.017103] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.017104] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#5: kworker/u64:0/12 <7> [87.017106] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [87.017174] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.017238] efi_pstore nfnetlink autofs4 <4> [87.017242] CPU: 5 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.017244] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.017245] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.017247] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [87.017212] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [87.017252] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.017320] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.017321] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [87.017323] RAX: ffffffffa120354b RBX: ffff88817256dd40 RCX: 0000000000000000 <4> [87.017325] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.017326] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.017327] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.017328] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.017329] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000 <4> [87.017331] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.017332] CR2: 00005a59bd37a758 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [87.017334] PKRU: 55555554 <4> [87.017335] Call Trace: <4> [87.017336] <TASK> <4> [87.017340] ? lock_acquire+0xc4/0x2f0 <4> [87.017344] ? lock_release+0xd0/0x2b0 <4> [87.017349] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.017354] process_one_work+0x239/0x760 <4> [87.017360] worker_thread+0x200/0x3f0 <4> [87.017363] ? __pfx_worker_thread+0x10/0x10 <4> [87.017365] kthread+0x10d/0x150 <4> [87.017368] ? __pfx_kthread+0x10/0x10 <4> [87.017372] ret_from_fork+0x3d4/0x480 <4> [87.017373] ? __pfx_kthread+0x10/0x10 <4> [87.017377] ret_from_fork_asm+0x1a/0x30 <4> [87.017384] </TASK> <4> [87.017385] irq event stamp: 1210449 <4> [87.017386] hardirqs last enabled at (1210455): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.017389] hardirqs last disabled at (1210460): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.017391] softirqs last enabled at (1209584): [<ffffffff8133ac13>] kernel_fpu_end+0x53/0x70 <4> [87.017393] softirqs last disabled at (1209582): [<ffffffff8133b324>] kernel_fpu_begin_mask+0xc4/0x120 <4> [87.017396] ---[ end trace 0000000000000000 ]--- <6> [87.017397] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [87.017466] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [87.017471] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [87.017714] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [87.017920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [87.018010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [87.018122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [87.018210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [87.018298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [87.018385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [87.018473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [87.018562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [87.018646] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [87.018742] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [87.018860] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [87.019869] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [87.030034] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [87.030284] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [87.031290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [87.031369] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [87.031446] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [87.031522] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [87.031600] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [87.031679] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [87.031755] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [87.031830] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [87.031904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [87.031978] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [87.032065] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [87.032138] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [87.032210] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [87.032283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [87.032356] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [87.032430] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [87.032504] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [87.032577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [87.032649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [87.032729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [87.032809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [87.032888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [87.032971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [87.033057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [87.033136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [87.033213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [87.033291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [87.033369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [87.033451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [87.033534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [87.033615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [87.033695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [87.033784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [87.033872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [87.033958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [87.034051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [87.034131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [87.034208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [87.034285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [87.034361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [87.034445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [87.034526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [87.034605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [87.034682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [87.034763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [87.034840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [87.034916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [87.034992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [87.035078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [87.035154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [87.035231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [87.035315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [87.035395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [87.035474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [87.035550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [87.035628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [87.035705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [87.035781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [87.035862] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [87.035973] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [87.035978] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3809, lrc_seqno=3809, guc_id=0, flags=0x73 in no process [-1] <7> [87.035980] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.036054] ------------[ cut here ]------------ <4> [87.036056] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.036057] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#0: kworker/u64:5/204 <4> [87.036129] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.036192] efi_pstore nfnetlink autofs4 <4> [87.036197] CPU: 0 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.036199] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.036200] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.036202] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.036207] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.036276] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.036278] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [87.036280] RAX: ffffffffa120354b RBX: ffff88817256dd40 RCX: 0000000000000000 <4> [87.036281] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.036282] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.036284] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.036285] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.036286] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [87.036288] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.036289] CR2: 00007724b3cbd4b0 CR3: 000000012bf77005 CR4: 0000000000f72ef0 <4> [87.036290] PKRU: 55555554 <4> [87.036292] Call Trace: <4> [87.036293] <TASK> <4> [87.036297] ? lock_acquire+0xc4/0x2f0 <4> [87.036301] ? lock_release+0xd0/0x2b0 <4> [87.036306] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.036312] process_one_work+0x239/0x760 <4> [87.036318] worker_thread+0x200/0x3f0 <4> [87.036321] ? __pfx_worker_thread+0x10/0x10 <4> [87.036323] kthread+0x10d/0x150 <4> [87.036326] ? __pfx_kthread+0x10/0x10 <4> [87.036329] ret_from_fork+0x3d4/0x480 <4> [87.036331] ? __pfx_kthread+0x10/0x10 <4> [87.036335] ret_from_fork_asm+0x1a/0x30 <4> [87.036342] </TASK> <4> [87.036343] irq event stamp: 394587 <4> [87.036344] hardirqs last enabled at (394593): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.036347] hardirqs last disabled at (394598): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.036349] softirqs last enabled at (393678): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.036352] softirqs last disabled at (393671): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.036354] ---[ end trace 0000000000000000 ]--- <6> [87.036356] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [87.036425] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [87.036431] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [87.037661] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [87.037781] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [87.037894] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [87.038107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [87.038199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [87.038295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [87.038384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [87.038472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [87.038559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [87.038646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [87.038733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [87.038815] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [87.038911] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [87.039031] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [87.040040] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [87.050760] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [87.051009] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [87.052001] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [87.052096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [87.052172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [87.052250] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [87.052327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [87.052402] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [87.052477] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [87.052552] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [87.052626] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [87.052701] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [87.052778] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [87.052856] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [87.052932] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [87.053007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [87.053096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [87.053170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [87.053245] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [87.053319] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [87.053391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [87.053472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [87.053553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [87.053633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [87.053714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [87.053792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [87.053869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [87.053945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [87.054025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [87.054104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [87.054186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [87.054268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [87.054349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [87.054429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [87.054514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [87.054598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [87.054682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [87.054762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [87.054842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [87.054919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [87.054997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [87.055084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [87.055164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [87.055246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [87.055328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [87.055408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [87.055490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [87.055568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [87.055645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [87.055722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [87.055802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [87.055883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [87.055963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [87.056052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [87.056131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [87.056210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [87.056287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [87.056365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [87.056442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [87.056523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [87.056606] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [87.056718] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [87.056722] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3809, lrc_seqno=3809, guc_id=0, flags=0x73 in no process [-1] <7> [87.056724] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.056783] ------------[ cut here ]------------ <4> [87.056784] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.056785] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#8: kworker/u64:1/120 <4> [87.056857] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.056921] efi_pstore nfnetlink autofs4 <4> [87.056926] CPU: 8 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.056928] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.056930] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.056931] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.056936] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.057006] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.057011] RSP: 0018:ffffc9000055bc98 EFLAGS: 00010246 <4> [87.057014] RAX: ffffffffa120354b RBX: ffff88817256dd40 RCX: 0000000000000000 <4> [87.057016] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.057017] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.057018] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.057020] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.057021] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [87.057023] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.057024] CR2: 0000771c67e00088 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [87.057026] PKRU: 55555554 <4> [87.057027] Call Trace: <4> [87.057029] <TASK> <4> [87.057033] ? lock_acquire+0xc4/0x2f0 <4> [87.057037] ? lock_release+0xd0/0x2b0 <4> [87.057042] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.057048] process_one_work+0x239/0x760 <4> [87.057054] worker_thread+0x200/0x3f0 <4> [87.057057] ? __pfx_worker_thread+0x10/0x10 <4> [87.057059] kthread+0x10d/0x150 <4> [87.057062] ? __pfx_kthread+0x10/0x10 <4> [87.057066] ret_from_fork+0x3d4/0x480 <4> [87.057068] ? __pfx_kthread+0x10/0x10 <4> [87.057072] ret_from_fork_asm+0x1a/0x30 <4> [87.057079] </TASK> <4> [87.057080] irq event stamp: 366781 <4> [87.057081] hardirqs last enabled at (366787): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.057084] hardirqs last disabled at (366792): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.057087] softirqs last enabled at (365808): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.057089] softirqs last disabled at (365801): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.057092] ---[ end trace 0000000000000000 ]--- <5> [87.058611] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3864, lrc_seqno=3864, guc_id=0, flags=0x73 in no process [-1] <7> [87.058614] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.058674] ------------[ cut here ]------------ <4> [87.058675] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.058676] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#8: kworker/u64:1/120 <4> [87.058746] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.058809] efi_pstore nfnetlink autofs4 <4> [87.058813] CPU: 8 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.058816] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.058817] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.058818] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.058822] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.058893] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.058894] RSP: 0018:ffffc9000055bc98 EFLAGS: 00010246 <4> [87.058896] RAX: ffffffffa120354b RBX: ffff8881725b5d40 RCX: 0000000000000000 <4> [87.058897] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.058899] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.058900] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.058901] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.058902] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [87.058904] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.058905] CR2: 0000771c67e00088 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [87.058906] PKRU: 55555554 <4> [87.058908] Call Trace: <4> [87.058909] <TASK> <4> [87.058912] ? lock_acquire+0xc4/0x2f0 <4> [87.058916] ? lock_release+0xd0/0x2b0 <4> [87.058922] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.058927] process_one_work+0x239/0x760 <4> [87.058933] worker_thread+0x200/0x3f0 <4> [87.058936] ? __pfx_worker_thread+0x10/0x10 <4> [87.058938] kthread+0x10d/0x150 <4> [87.058941] ? __pfx_kthread+0x10/0x10 <4> [87.058944] ret_from_fork+0x3d4/0x480 <4> [87.058946] ? __pfx_kthread+0x10/0x10 <4> [87.058950] ret_from_fork_asm+0x1a/0x30 <4> [87.058957] </TASK> <4> [87.058958] irq event stamp: 369407 <4> [87.058959] hardirqs last enabled at (369413): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.058962] hardirqs last disabled at (369418): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.058964] softirqs last enabled at (365808): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.058966] softirqs last disabled at (365801): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.058968] ---[ end trace 0000000000000000 ]--- <6> [87.058970] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <7> [87.059062] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [87.059165] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [87.059264] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [87.059269] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [87.059358] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [87.059561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [87.059651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [87.059744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [87.059833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [87.059922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [87.060014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [87.060102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [87.060195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [87.060282] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [87.060378] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [87.060493] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [87.061501] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [87.072515] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [87.072764] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [87.073748] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [87.073828] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [87.073906] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [87.073984] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [87.074071] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [87.074147] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [87.074221] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [87.074294] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [87.074369] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [87.074443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [87.074517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [87.074591] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [87.074664] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [87.074738] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [87.074812] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [87.074885] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [87.074959] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [87.075040] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [87.075114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [87.075194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [87.075273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [87.075351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [87.075432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [87.075510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [87.075591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [87.075670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [87.075748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [87.075828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [87.075909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [87.075987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [87.076076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [87.076155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [87.076241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [87.076329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [87.076415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [87.076496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [87.076576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [87.076653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [87.076732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [87.076808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [87.076887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [87.076965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [87.077051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [87.077126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [87.077207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [87.077284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [87.077361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [87.077436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [87.077512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [87.077586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [87.077662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [87.077740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [87.077820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [87.077899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [87.077977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [87.078065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [87.078141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [87.078221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [87.078303] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [87.078414] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [87.078418] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3864, lrc_seqno=3864, guc_id=0, flags=0x73 in no process [-1] <7> [87.078420] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.078479] ------------[ cut here ]------------ <4> [87.078480] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.078481] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#8: kworker/u64:1/120 <4> [87.078552] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.078615] efi_pstore nfnetlink autofs4 <4> [87.078619] CPU: 8 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.078622] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.078623] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.078624] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.078629] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.078698] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.078699] RSP: 0018:ffffc9000055bc98 EFLAGS: 00010246 <4> [87.078702] RAX: ffffffffa120354b RBX: ffff8881725b5d40 RCX: 0000000000000000 <4> [87.078703] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.078704] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.078705] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.078707] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.078708] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [87.078709] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.078711] CR2: 0000771c67e00088 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [87.078712] PKRU: 55555554 <4> [87.078713] Call Trace: <4> [87.078714] <TASK> <4> [87.078718] ? lock_acquire+0xc4/0x2f0 <4> [87.078723] ? lock_release+0xd0/0x2b0 <4> [87.078728] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.078733] process_one_work+0x239/0x760 <4> [87.078739] worker_thread+0x200/0x3f0 <4> [87.078742] ? __pfx_worker_thread+0x10/0x10 <4> [87.078745] kthread+0x10d/0x150 <4> [87.078748] ? __pfx_kthread+0x10/0x10 <4> [87.078751] ret_from_fork+0x3d4/0x480 <4> [87.078753] ? __pfx_kthread+0x10/0x10 <4> [87.078757] ret_from_fork_asm+0x1a/0x30 <4> [87.078764] </TASK> <4> [87.078765] irq event stamp: 372539 <4> [87.078766] hardirqs last enabled at (372545): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.078769] hardirqs last disabled at (372550): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.078771] softirqs last enabled at (371678): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.078773] softirqs last disabled at (371667): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.078776] ---[ end trace 0000000000000000 ]--- <6> [87.078777] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [87.078846] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [87.078852] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [87.080089] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [87.080191] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [87.080292] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [87.080500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [87.080592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [87.080686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [87.080775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [87.080862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [87.080949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [87.081043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [87.081131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [87.081214] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [87.081313] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [87.081430] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [87.082438] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [87.093009] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [87.093257] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [87.094222] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [87.094301] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [87.094378] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [87.094454] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [87.094531] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [87.094607] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [87.094682] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [87.094758] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [87.094836] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [87.094912] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [87.094987] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [87.095078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [87.095153] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [87.095228] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [87.095301] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [87.095375] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [87.095447] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [87.095520] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [87.095592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [87.095673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [87.095754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [87.095833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [87.095914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [87.095992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [87.096084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [87.096162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [87.096242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [87.096325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [87.096406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [87.096483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [87.096563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [87.096644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [87.096729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [87.096813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [87.096897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [87.096978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [87.097065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [87.097143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [87.097220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [87.097296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [87.097376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [87.097454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [87.097535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [87.097616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [87.097699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [87.097779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [87.097860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [87.097938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [87.098024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [87.098101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [87.098178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [87.098256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [87.098334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [87.098413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [87.098493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [87.098572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [87.098648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [87.098724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [87.098804] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [87.098915] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [87.098919] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3864, lrc_seqno=3864, guc_id=0, flags=0x73 in no process [-1] <7> [87.098921] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.098980] ------------[ cut here ]------------ <4> [87.098981] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.098983] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#0: kworker/u64:5/204 <4> [87.099067] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.099133] efi_pstore nfnetlink autofs4 <4> [87.099138] CPU: 0 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.099141] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.099142] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.099143] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.099149] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.099218] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.099219] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [87.099222] RAX: ffffffffa120354b RBX: ffff8881725b5d40 RCX: 0000000000000000 <4> [87.099223] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.099224] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.099226] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.099227] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.099228] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [87.099230] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.099231] CR2: 00007724b3cbd4b0 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [87.099233] PKRU: 55555554 <4> [87.099234] Call Trace: <4> [87.099235] <TASK> <4> [87.099239] ? lock_acquire+0xc4/0x2f0 <4> [87.099243] ? lock_release+0xd0/0x2b0 <4> [87.099249] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.099255] process_one_work+0x239/0x760 <4> [87.099261] worker_thread+0x200/0x3f0 <4> [87.099263] ? __pfx_worker_thread+0x10/0x10 <4> [87.099266] kthread+0x10d/0x150 <4> [87.099269] ? __pfx_kthread+0x10/0x10 <4> [87.099272] ret_from_fork+0x3d4/0x480 <4> [87.099274] ? __pfx_kthread+0x10/0x10 <4> [87.099278] ret_from_fork_asm+0x1a/0x30 <4> [87.099285] </TASK> <4> [87.099286] irq event stamp: 398241 <4> [87.099287] hardirqs last enabled at (398247): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.099290] hardirqs last disabled at (398252): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.099292] softirqs last enabled at (397498): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.099295] softirqs last disabled at (397487): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.099297] ---[ end trace 0000000000000000 ]--- <5> [87.100681] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3919, lrc_seqno=3919, guc_id=0, flags=0x73 in no process [-1] <7> [87.100684] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.100745] ------------[ cut here ]------------ <4> [87.100746] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.100747] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#0: kworker/u64:5/204 <4> [87.100818] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.100882] efi_pstore nfnetlink autofs4 <4> [87.100886] CPU: 0 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.100888] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.100890] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.100891] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.100896] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.100966] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.100968] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [87.100970] RAX: ffffffffa120354b RBX: ffff8881725fa440 RCX: 0000000000000000 <4> [87.100971] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.100972] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.100974] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.100975] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.100976] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [87.100977] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.100979] CR2: 00007724b3cbd4b0 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [87.100980] PKRU: 55555554 <4> [87.100981] Call Trace: <4> [87.100982] <TASK> <4> [87.100986] ? lock_acquire+0xc4/0x2f0 <4> [87.100991] ? lock_release+0xd0/0x2b0 <4> [87.100996] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.101009] process_one_work+0x239/0x760 <4> [87.101016] worker_thread+0x200/0x3f0 <4> [87.101019] ? __pfx_worker_thread+0x10/0x10 <4> [87.101021] kthread+0x10d/0x150 <4> [87.101024] ? __pfx_kthread+0x10/0x10 <4> [87.101028] ret_from_fork+0x3d4/0x480 <4> [87.101030] ? __pfx_kthread+0x10/0x10 <4> [87.101034] ret_from_fork_asm+0x1a/0x30 <4> [87.101041] </TASK> <4> [87.101042] irq event stamp: 400839 <4> [87.101044] hardirqs last enabled at (400845): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.101047] hardirqs last disabled at (400850): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.101049] softirqs last enabled at (397498): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.101051] softirqs last disabled at (397487): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.101053] ---[ end trace 0000000000000000 ]--- <7> [87.101067] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [87.101171] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [87.101271] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [87.101341] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [87.101347] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [87.101603] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [87.101811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [87.101904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [87.102006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [87.102096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [87.102183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [87.102270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [87.102359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [87.102447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [87.102531] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [87.102627] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [87.102751] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [87.103757] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [87.114002] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [87.114251] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [87.115269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [87.115349] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [87.115424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [87.115502] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [87.115579] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [87.115654] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [87.115729] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [87.115804] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [87.115878] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [87.115952] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [87.116036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [87.116109] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [87.116184] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [87.116259] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [87.116335] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [87.116409] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [87.116484] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [87.116557] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [87.116629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [87.116710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [87.116791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [87.116871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [87.116951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [87.117037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [87.117115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [87.117192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [87.117269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [87.117350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [87.117429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [87.117508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [87.117587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [87.117666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [87.117751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [87.117836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [87.117924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [87.118010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [87.118090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [87.118167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [87.118245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [87.118321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [87.118401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [87.118480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [87.118561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [87.118640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [87.118721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [87.118799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [87.118876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [87.118953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [87.119038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [87.119114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [87.119192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [87.119274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [87.119353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [87.119430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [87.119506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [87.119583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [87.119658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [87.119734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [87.119816] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [87.119928] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [87.119932] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3919, lrc_seqno=3919, guc_id=0, flags=0x73 in no process [-1] <7> [87.119935] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.119996] ------------[ cut here ]------------ <4> [87.119998] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.119999] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#5: kworker/u64:0/12 <4> [87.120071] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.120135] efi_pstore nfnetlink autofs4 <4> [87.120140] CPU: 5 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.120143] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.120144] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.120146] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.120151] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.120221] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.120223] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [87.120225] RAX: ffffffffa120354b RBX: ffff8881725fa440 RCX: 0000000000000000 <4> [87.120227] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.120228] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.120229] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.120230] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.120232] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000 <4> [87.120234] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.120235] CR2: 00005a59bd37a758 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [87.120237] PKRU: 55555554 <4> [87.120238] Call Trace: <4> [87.120239] <TASK> <4> [87.120243] ? lock_acquire+0xc4/0x2f0 <4> [87.120248] ? lock_release+0xd0/0x2b0 <4> [87.120253] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.120259] process_one_work+0x239/0x760 <4> [87.120265] worker_thread+0x200/0x3f0 <4> [87.120267] ? __pfx_worker_thread+0x10/0x10 <4> [87.120270] kthread+0x10d/0x150 <4> [87.120273] ? __pfx_kthread+0x10/0x10 <4> [87.120276] ret_from_fork+0x3d4/0x480 <4> [87.120278] ? __pfx_kthread+0x10/0x10 <4> [87.120281] ret_from_fork_asm+0x1a/0x30 <4> [87.120289] </TASK> <4> [87.120290] irq event stamp: 1218733 <4> [87.120291] hardirqs last enabled at (1218739): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.120294] hardirqs last disabled at (1218744): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.120296] softirqs last enabled at (1217730): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.120298] softirqs last disabled at (1217723): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.120300] ---[ end trace 0000000000000000 ]--- <6> [87.120303] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [87.120372] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [87.120378] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [87.121625] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [87.121727] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [87.121832] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [87.122041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [87.122133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [87.122226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [87.122313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [87.122403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [87.122493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [87.122583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [87.122672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [87.122754] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [87.122849] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [87.122965] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [87.123977] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [87.134711] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [87.134959] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [87.135986] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [87.136080] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [87.136156] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [87.136233] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [87.136309] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [87.136386] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [87.136462] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [87.136538] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [87.136613] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [87.136687] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [87.136763] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [87.136840] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [87.136915] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [87.136996] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [87.137071] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [87.137145] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [87.137219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [87.137292] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [87.137367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [87.137450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [87.137532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [87.137611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [87.137690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [87.137767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [87.137844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [87.137921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [87.138000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [87.138079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [87.138160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [87.138240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [87.138323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [87.138403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [87.138488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [87.138572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [87.138655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [87.138735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [87.138815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [87.138891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [87.138969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [87.139052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [87.139131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [87.139208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [87.139285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [87.139361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [87.139444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [87.139524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [87.139604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [87.139680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [87.139758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [87.139837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [87.139917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [87.140000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [87.140079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [87.140156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [87.140232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [87.140310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [87.140385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [87.140459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [87.140538] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [87.140648] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [87.140652] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3919, lrc_seqno=3919, guc_id=0, flags=0x73 in no process [-1] <7> [87.140654] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.140712] ------------[ cut here ]------------ <4> [87.140713] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.140715] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#8: kworker/u64:1/120 <4> [87.140785] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.140848] efi_pstore nfnetlink autofs4 <4> [87.140852] CPU: 8 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.140855] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.140856] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.140857] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.140862] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.140932] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.140934] RSP: 0018:ffffc9000055bc98 EFLAGS: 00010246 <4> [87.140936] RAX: ffffffffa120354b RBX: ffff8881725fa440 RCX: 0000000000000000 <4> [87.140937] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.140939] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.140940] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.140941] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.140943] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [87.140944] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.140945] CR2: 0000771c67e00088 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [87.140947] PKRU: 55555554 <4> [87.140948] Call Trace: <4> [87.140949] <TASK> <4> [87.140953] ? lock_acquire+0xc4/0x2f0 <4> [87.140957] ? lock_release+0xd0/0x2b0 <4> [87.140962] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.140968] process_one_work+0x239/0x760 <4> [87.140974] worker_thread+0x200/0x3f0 <4> [87.140977] ? __pfx_worker_thread+0x10/0x10 <4> [87.140979] kthread+0x10d/0x150 <4> [87.140982] ? __pfx_kthread+0x10/0x10 <4> [87.140985] ret_from_fork+0x3d4/0x480 <4> [87.140992] ? __pfx_kthread+0x10/0x10 <4> [87.140996] ret_from_fork_asm+0x1a/0x30 <4> [87.141003] </TASK> <4> [87.141005] irq event stamp: 376237 <4> [87.141006] hardirqs last enabled at (376243): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.141009] hardirqs last disabled at (376248): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.141011] softirqs last enabled at (376218): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.141014] softirqs last disabled at (376207): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.141016] ---[ end trace 0000000000000000 ]--- <5> [87.141613] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3974, lrc_seqno=3974, guc_id=0, flags=0x73 in no process [-1] <7> [87.141616] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.141842] ------------[ cut here ]------------ <4> [87.141844] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.141845] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#5: kworker/u64:0/12 <4> [87.141922] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.142003] efi_pstore nfnetlink autofs4 <4> [87.142011] CPU: 5 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.142015] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.142017] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.142019] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.142027] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.142110] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.142113] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [87.142115] RAX: ffffffffa120354b RBX: ffff8881707d3040 RCX: 0000000000000000 <4> [87.142116] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.142118] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.142119] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.142120] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.142121] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000 <4> [87.142123] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.142124] CR2: 00005a59bd37a758 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [87.142126] PKRU: 55555554 <4> [87.142127] Call Trace: <4> [87.142129] <TASK> <4> [87.142134] ? lock_acquire+0xc4/0x2f0 <4> [87.142139] ? lock_release+0xd0/0x2b0 <4> [87.142144] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.142150] process_one_work+0x239/0x760 <4> [87.142156] worker_thread+0x200/0x3f0 <4> [87.142159] ? __pfx_worker_thread+0x10/0x10 <4> [87.142161] kthread+0x10d/0x150 <4> [87.142164] ? __pfx_kthread+0x10/0x10 <4> [87.142168] ret_from_fork+0x3d4/0x480 <4> [87.142170] ? __pfx_kthread+0x10/0x10 <4> [87.142174] ret_from_fork_asm+0x1a/0x30 <4> [87.142181] </TASK> <4> [87.142182] irq event stamp: 1220975 <4> [87.142183] hardirqs last enabled at (1220981): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.142187] hardirqs last disabled at (1220986): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.142189] softirqs last enabled at (1220710): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.142193] softirqs last disabled at (1220701): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.142195] ---[ end trace 0000000000000000 ]--- <6> [87.142198] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [87.142273] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [87.142329] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [87.142625] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [87.142731] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [87.142837] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [87.143044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [87.143133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [87.143226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [87.143316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [87.143404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [87.143492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [87.143581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [87.143670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [87.143753] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [87.143848] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [87.143963] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [87.144978] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [87.154992] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [87.155240] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [87.156269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [87.156348] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [87.156424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [87.156501] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [87.156578] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [87.156652] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [87.156725] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [87.156799] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [87.156874] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [87.156948] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [87.157031] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [87.157104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [87.157178] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [87.157251] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [87.157324] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [87.157398] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [87.157471] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [87.157544] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [87.157619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [87.157702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [87.157782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [87.157861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [87.157940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [87.158026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [87.158103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [87.158181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [87.158257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [87.158337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [87.158418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [87.158496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [87.158574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [87.158653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [87.158741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [87.158827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [87.158913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [87.158998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [87.159078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [87.159155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [87.159232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [87.159308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [87.159388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [87.159466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [87.159542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [87.159618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [87.159698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [87.159773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [87.159849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [87.159925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [87.160010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [87.160090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [87.160168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [87.160249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [87.160327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [87.160408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [87.160487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [87.160566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [87.160643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [87.160719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [87.160799] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [87.160910] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [87.160914] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3974, lrc_seqno=3974, guc_id=0, flags=0x73 in no process [-1] <7> [87.160916] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.160974] ------------[ cut here ]------------ <4> [87.160975] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.160976] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#5: kworker/u64:0/12 <4> [87.161062] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.161127] efi_pstore nfnetlink autofs4 <4> [87.161131] CPU: 5 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.161134] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.161135] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.161136] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.161141] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.161212] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.161213] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [87.161215] RAX: ffffffffa120354b RBX: ffff8881707d3040 RCX: 0000000000000000 <4> [87.161217] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.161218] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.161220] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.161221] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.161222] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000 <4> [87.161224] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.161225] CR2: 00005a59bd37a758 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [87.161227] PKRU: 55555554 <4> [87.161228] Call Trace: <4> [87.161229] <TASK> <4> [87.161233] ? lock_acquire+0xc4/0x2f0 <4> [87.161238] ? lock_release+0xd0/0x2b0 <4> [87.161243] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.161249] process_one_work+0x239/0x760 <4> [87.161255] worker_thread+0x200/0x3f0 <4> [87.161257] ? __pfx_worker_thread+0x10/0x10 <4> [87.161260] kthread+0x10d/0x150 <4> [87.161263] ? __pfx_kthread+0x10/0x10 <4> [87.161266] ret_from_fork+0x3d4/0x480 <4> [87.161268] ? __pfx_kthread+0x10/0x10 <4> [87.161272] ret_from_fork_asm+0x1a/0x30 <4> [87.161279] </TASK> <4> [87.161280] irq event stamp: 1224209 <4> [87.161281] hardirqs last enabled at (1224215): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.161284] hardirqs last disabled at (1224220): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.161286] softirqs last enabled at (1223466): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.161288] softirqs last disabled at (1223455): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.161291] ---[ end trace 0000000000000000 ]--- <6> [87.161293] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [87.161362] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [87.161368] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [87.162485] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [87.162599] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [87.162703] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [87.162907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [87.163006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [87.163099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [87.163187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [87.163274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [87.163359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [87.163444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [87.163531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [87.163613] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [87.163707] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [87.163823] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [87.164829] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [87.174987] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [87.175236] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [87.176244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [87.176324] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [87.176399] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [87.176476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [87.176551] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [87.176627] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [87.176704] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [87.176781] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [87.176857] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [87.176933] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [87.177020] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [87.177099] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [87.177177] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [87.177253] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [87.177327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [87.177402] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [87.177476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [87.177549] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [87.177623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [87.177708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [87.177790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [87.177868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [87.177947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [87.178036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [87.178113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [87.178189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [87.178267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [87.178351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [87.178432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [87.178511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [87.178591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [87.178671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [87.178754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [87.178839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [87.178922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [87.179015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [87.179098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [87.179177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [87.179254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [87.179330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [87.179410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [87.179488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [87.179565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [87.179640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [87.179724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [87.179804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [87.179884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [87.179962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [87.180056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [87.180132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [87.180208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [87.180286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [87.180363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [87.180440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [87.180517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [87.180594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [87.180672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [87.180751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [87.180832] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [87.180943] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [87.180947] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=3974, lrc_seqno=3974, guc_id=0, flags=0x73 in no process [-1] <7> [87.180949] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.181866] ------------[ cut here ]------------ <4> [87.181867] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.181869] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#0: kworker/u64:5/204 <4> [87.181941] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.182015] efi_pstore nfnetlink autofs4 <4> [87.182020] CPU: 0 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.182023] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.182024] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.182026] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.182031] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.182101] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.182103] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [87.182105] RAX: ffffffffa120354b RBX: ffff8881707d3040 RCX: 0000000000000000 <4> [87.182106] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.182108] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.182109] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.182110] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.182111] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [87.182113] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.182114] CR2: 00007724b3cbd4b0 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [87.182116] PKRU: 55555554 <4> [87.182117] Call Trace: <4> [87.182118] <TASK> <4> [87.182122] ? lock_acquire+0xc4/0x2f0 <4> [87.182127] ? lock_release+0xd0/0x2b0 <4> [87.182132] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.182137] process_one_work+0x239/0x760 <4> [87.182143] worker_thread+0x200/0x3f0 <4> [87.182146] ? __pfx_worker_thread+0x10/0x10 <4> [87.182148] kthread+0x10d/0x150 <4> [87.182151] ? __pfx_kthread+0x10/0x10 <4> [87.182155] ret_from_fork+0x3d4/0x480 <4> [87.182157] ? __pfx_kthread+0x10/0x10 <4> [87.182160] ret_from_fork_asm+0x1a/0x30 <4> [87.182167] </TASK> <4> [87.182168] irq event stamp: 405289 <4> [87.182170] hardirqs last enabled at (405295): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.182173] hardirqs last disabled at (405300): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.182175] softirqs last enabled at (404842): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.182177] softirqs last disabled at (404831): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.182179] ---[ end trace 0000000000000000 ]--- <7> [87.182783] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [87.182885] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [87.182991] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4029, lrc_seqno=4029, guc_id=0, flags=0x73 in no process [-1] <7> [87.182994] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.183053] ------------[ cut here ]------------ <4> [87.183054] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.183056] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#0: kworker/u64:5/204 <4> [87.183129] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.183192] efi_pstore nfnetlink autofs4 <4> [87.183196] CPU: 0 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.183199] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.183200] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.183201] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.183206] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.183275] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.183277] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [87.183279] RAX: ffffffffa120354b RBX: ffff88817469c540 RCX: 0000000000000000 <4> [87.183280] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.183281] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.183282] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.183284] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.183285] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [87.183286] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.183288] CR2: 00007724b3cbd4b0 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [87.183289] PKRU: 55555554 <4> [87.183290] Call Trace: <4> [87.183291] <TASK> <4> [87.183295] ? lock_acquire+0xc4/0x2f0 <4> [87.183299] ? lock_release+0xd0/0x2b0 <4> [87.183304] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.183310] process_one_work+0x239/0x760 <4> [87.183316] worker_thread+0x200/0x3f0 <4> [87.183319] ? __pfx_worker_thread+0x10/0x10 <4> [87.183321] kthread+0x10d/0x150 <4> [87.183324] ? __pfx_kthread+0x10/0x10 <4> [87.183327] ret_from_fork+0x3d4/0x480 <4> [87.183329] ? __pfx_kthread+0x10/0x10 <4> [87.183333] ret_from_fork_asm+0x1a/0x30 <4> [87.183340] </TASK> <4> [87.183341] irq event stamp: 408017 <4> [87.183342] hardirqs last enabled at (408023): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.183344] hardirqs last disabled at (408028): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.183347] softirqs last enabled at (404842): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.183349] softirqs last disabled at (404831): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.183351] ---[ end trace 0000000000000000 ]--- <6> [87.183353] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [87.183423] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [87.183429] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [87.183488] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [87.183695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [87.183787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [87.183883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [87.183973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [87.184076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [87.184163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [87.184251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [87.184342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [87.184430] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [87.184526] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [87.184644] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [87.185653] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [87.195982] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [87.196231] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [87.197210] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [87.197290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [87.197365] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [87.197442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [87.197516] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [87.197591] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [87.197665] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [87.197738] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [87.197812] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [87.197885] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [87.197958] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [87.198043] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [87.198117] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [87.198191] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [87.198264] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [87.198337] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [87.198410] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [87.198484] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [87.198561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [87.198643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [87.198725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [87.198804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [87.198884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [87.198961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [87.199051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [87.199129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [87.199206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [87.199286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [87.199365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [87.199447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [87.199530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [87.199611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [87.199695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [87.199780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [87.199863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [87.199943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [87.200030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [87.200107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [87.200183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [87.200259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [87.200338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [87.200415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [87.200493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [87.200568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [87.200648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [87.200729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [87.200809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [87.200887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [87.200966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [87.201054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [87.201130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [87.201208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [87.201284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [87.201360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [87.201439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [87.201518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [87.201595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [87.201671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [87.201751] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [87.201861] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [87.201865] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4029, lrc_seqno=4029, guc_id=0, flags=0x73 in no process [-1] <7> [87.201867] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.201927] ------------[ cut here ]------------ <4> [87.201928] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.201929] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#8: kworker/u64:1/120 <4> [87.202008] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.202072] efi_pstore nfnetlink autofs4 <4> [87.202077] CPU: 8 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.202080] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.202081] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.202082] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.202087] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.202157] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.202159] RSP: 0018:ffffc9000055bc98 EFLAGS: 00010246 <4> [87.202161] RAX: ffffffffa120354b RBX: ffff88817469c540 RCX: 0000000000000000 <4> [87.202163] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.202164] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.202166] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.202167] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.202168] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [87.202170] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.202172] CR2: 0000771c67e00088 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [87.202173] PKRU: 55555554 <4> [87.202174] Call Trace: <4> [87.202175] <TASK> <4> [87.202180] ? lock_acquire+0xc4/0x2f0 <4> [87.202184] ? lock_release+0xd0/0x2b0 <4> [87.202190] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.202195] process_one_work+0x239/0x760 <4> [87.202201] worker_thread+0x200/0x3f0 <4> [87.202204] ? __pfx_worker_thread+0x10/0x10 <4> [87.202207] kthread+0x10d/0x150 <4> [87.202210] ? __pfx_kthread+0x10/0x10 <4> [87.202213] ret_from_fork+0x3d4/0x480 <4> [87.202215] ? __pfx_kthread+0x10/0x10 <4> [87.202219] ret_from_fork_asm+0x1a/0x30 <4> [87.202226] </TASK> <4> [87.202227] irq event stamp: 383971 <4> [87.202228] hardirqs last enabled at (383977): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.202231] hardirqs last disabled at (383982): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.202233] softirqs last enabled at (382880): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.202236] softirqs last disabled at (382875): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.202238] ---[ end trace 0000000000000000 ]--- <6> [87.202240] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [87.202310] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [87.202316] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [87.202723] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [87.202924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [87.203016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [87.203105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [87.203190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [87.203275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [87.203360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [87.203450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [87.203539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [87.203623] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [87.203719] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [87.203838] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [87.204844] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [87.215565] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [87.215814] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [87.216902] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [87.217099] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [87.217196] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [87.217284] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [87.217366] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [87.217448] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [87.217527] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [87.217605] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [87.217683] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [87.217762] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [87.217839] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [87.217918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [87.218016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [87.218133] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [87.218247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [87.218360] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [87.218470] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [87.218579] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [87.218690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [87.218809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [87.218929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [87.219066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [87.219185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [87.219299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [87.219415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [87.219529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [87.219642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [87.219761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [87.219881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [87.220003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [87.220126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [87.220245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [87.220369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [87.220491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [87.220615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [87.220736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [87.220857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [87.220996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [87.221091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [87.221177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [87.221265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [87.221349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [87.221431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [87.221509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [87.221592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [87.221670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [87.221748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [87.221825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [87.221903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [87.221988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [87.222065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [87.222148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [87.222229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [87.222308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [87.222385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [87.222464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [87.222541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [87.222616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [87.222698] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [87.222812] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [87.222817] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4029, lrc_seqno=4029, guc_id=0, flags=0x73 in no process [-1] <7> [87.222819] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.222878] ------------[ cut here ]------------ <4> [87.222879] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.222881] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#6: kworker/u64:1/120 <4> [87.222953] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.223023] efi_pstore nfnetlink autofs4 <4> [87.223028] CPU: 6 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.223031] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.223032] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.223033] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.223039] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.223108] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.223110] RSP: 0018:ffffc9000055bc98 EFLAGS: 00010246 <4> [87.223112] RAX: ffffffffa120354b RBX: ffff88817469c540 RCX: 0000000000000000 <4> [87.223114] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.223115] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.223116] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.223118] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.223119] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [87.223121] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.223122] CR2: 000075ce18fae000 CR3: 000000012bf77004 CR4: 0000000000f72ef0 <4> [87.223123] PKRU: 55555554 <4> [87.223125] Call Trace: <4> [87.223126] <TASK> <4> [87.223130] ? lock_acquire+0xc4/0x2f0 <4> [87.223135] ? lock_release+0xd0/0x2b0 <4> [87.223140] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.223145] process_one_work+0x239/0x760 <4> [87.223152] worker_thread+0x200/0x3f0 <4> [87.223154] ? __pfx_worker_thread+0x10/0x10 <4> [87.223157] kthread+0x10d/0x150 <4> [87.223160] ? __pfx_kthread+0x10/0x10 <4> [87.223163] ret_from_fork+0x3d4/0x480 <4> [87.223165] ? __pfx_kthread+0x10/0x10 <4> [87.223169] ret_from_fork_asm+0x1a/0x30 <4> [87.223176] </TASK> <4> [87.223177] irq event stamp: 387097 <4> [87.223178] hardirqs last enabled at (387103): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.223181] hardirqs last disabled at (387108): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.223183] softirqs last enabled at (386194): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.223186] softirqs last disabled at (386183): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.223188] ---[ end trace 0000000000000000 ]--- <5> [87.224267] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4084, lrc_seqno=4084, guc_id=0, flags=0x73 in no process [-1] <7> [87.224271] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.224363] ------------[ cut here ]------------ <4> [87.224365] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.224366] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#8: kworker/u64:5/204 <4> [87.224439] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.224507] efi_pstore nfnetlink autofs4 <4> [87.224513] CPU: 8 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.224517] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.224518] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.224519] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.224524] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.224594] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.224596] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [87.224598] RAX: ffffffffa120354b RBX: ffff8881746e4540 RCX: 0000000000000000 <4> [87.224599] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.224601] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.224602] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.224603] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.224604] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [87.224606] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.224607] CR2: 000075ce18faf000 CR3: 000000012bf77006 CR4: 0000000000f72ef0 <4> [87.224609] PKRU: 55555554 <4> [87.224610] Call Trace: <4> [87.224611] <TASK> <4> [87.224615] ? lock_acquire+0xc4/0x2f0 <4> [87.224619] ? lock_release+0xd0/0x2b0 <4> [87.224625] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.224630] process_one_work+0x239/0x760 <4> [87.224636] worker_thread+0x200/0x3f0 <4> [87.224639] ? __pfx_worker_thread+0x10/0x10 <4> [87.224641] kthread+0x10d/0x150 <4> [87.224644] ? __pfx_kthread+0x10/0x10 <4> [87.224648] ret_from_fork+0x3d4/0x480 <4> [87.224649] ? __pfx_kthread+0x10/0x10 <4> [87.224653] ret_from_fork_asm+0x1a/0x30 <4> [87.224660] </TASK> <4> [87.224661] irq event stamp: 411489 <4> [87.224662] hardirqs last enabled at (411495): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.224665] hardirqs last disabled at (411500): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.224667] softirqs last enabled at (409044): [<ffffffff8133ac13>] kernel_fpu_end+0x53/0x70 <4> [87.224670] softirqs last disabled at (409042): [<ffffffff8133b324>] kernel_fpu_begin_mask+0xc4/0x120 <4> [87.224672] ---[ end trace 0000000000000000 ]--- <6> [87.224674] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [87.224744] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [87.224750] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [87.224875] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [87.225038] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [87.225231] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [87.225453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [87.225553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [87.225652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [87.225745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [87.225838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [87.225929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [87.226034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [87.226129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [87.226219] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [87.226320] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [87.226443] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [87.227455] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [87.237974] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [87.238255] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [87.239290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [87.239376] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [87.239458] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [87.239541] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [87.239623] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [87.239704] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [87.239783] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [87.239862] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [87.239941] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [87.240031] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [87.240115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [87.240195] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [87.240275] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [87.240355] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [87.240433] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [87.240512] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [87.240590] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [87.240668] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [87.240747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [87.240835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [87.240923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [87.241015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [87.241100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [87.241183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [87.241265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [87.241346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [87.241428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [87.241513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [87.241597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [87.241681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [87.241766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [87.241848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [87.241937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [87.242034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [87.242122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [87.242209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [87.242293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [87.242374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [87.242455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [87.242534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [87.242616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [87.242699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [87.242785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [87.242868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [87.242954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [87.243048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [87.243131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [87.243212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [87.243295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [87.243380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [87.243464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [87.243550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [87.243634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [87.243716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [87.243796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [87.243879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [87.243959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [87.244052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [87.244136] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [87.244252] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [87.244256] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4084, lrc_seqno=4084, guc_id=0, flags=0x73 in no process [-1] <7> [87.244259] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.244322] ------------[ cut here ]------------ <4> [87.244323] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.244324] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#5: kworker/u64:0/12 <4> [87.244401] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.244465] efi_pstore nfnetlink autofs4 <4> [87.244469] CPU: 5 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.244472] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.244473] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.244475] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.244480] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.244554] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.244556] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [87.244559] RAX: ffffffffa120354b RBX: ffff8881746e4540 RCX: 0000000000000000 <4> [87.244560] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.244561] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.244563] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.244564] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.244565] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000 <4> [87.244567] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.244568] CR2: 00005a59bd37a758 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [87.244569] PKRU: 55555554 <4> [87.244571] Call Trace: <4> [87.244572] <TASK> <4> [87.244576] ? lock_acquire+0xc4/0x2f0 <4> [87.244581] ? lock_release+0xd0/0x2b0 <4> [87.244587] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.244592] process_one_work+0x239/0x760 <4> [87.244598] worker_thread+0x200/0x3f0 <4> [87.244601] ? __pfx_worker_thread+0x10/0x10 <4> [87.244604] kthread+0x10d/0x150 <4> [87.244607] ? __pfx_kthread+0x10/0x10 <4> [87.244610] ret_from_fork+0x3d4/0x480 <4> [87.244612] ? __pfx_kthread+0x10/0x10 <4> [87.244615] ret_from_fork_asm+0x1a/0x30 <4> [87.244623] </TASK> <4> [87.244624] irq event stamp: 1229823 <4> [87.244625] hardirqs last enabled at (1229829): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.244628] hardirqs last disabled at (1229834): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.244630] softirqs last enabled at (1228894): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.244632] softirqs last disabled at (1228887): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.244635] ---[ end trace 0000000000000000 ]--- <6> [87.244637] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [87.244710] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [87.244715] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [87.245019] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [87.245224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [87.245319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [87.245417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [87.245510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [87.245603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [87.245696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [87.245789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [87.245882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [87.245974] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [87.246077] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [87.246200] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [87.247211] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [87.257938] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [87.258203] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [87.259232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [87.259317] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [87.259397] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [87.259478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [87.259559] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [87.259639] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [87.259719] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [87.259799] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [87.259884] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [87.259967] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [87.260046] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [87.260124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [87.260202] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [87.260280] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [87.260356] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [87.260433] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [87.260511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [87.260588] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [87.260664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [87.260753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [87.260841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [87.260925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [87.261018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [87.261101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [87.261186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [87.261269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [87.261351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [87.261436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [87.261519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [87.261603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [87.261687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [87.261771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [87.261860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [87.261947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [87.262046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [87.262135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [87.262223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [87.262309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [87.262392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [87.262474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [87.262559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [87.262640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [87.262722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [87.262803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [87.262888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [87.262972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [87.263054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [87.263135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [87.263217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [87.263297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [87.263377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [87.263459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [87.263542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [87.263627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [87.263711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [87.263797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [87.263878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [87.263964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [87.264052] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [87.264184] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [87.265072] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4084, lrc_seqno=4084, guc_id=0, flags=0x73 in no process [-1] <7> [87.265075] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.265145] ------------[ cut here ]------------ <4> [87.265146] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.265147] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#5: kworker/u64:0/12 <4> [87.265223] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.265286] efi_pstore nfnetlink autofs4 <4> [87.265290] CPU: 5 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.265293] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.265294] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.265296] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.265301] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.265375] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.265377] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [87.265379] RAX: ffffffffa120354b RBX: ffff8881746e4540 RCX: 0000000000000000 <4> [87.265380] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.265382] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.265383] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.265384] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.265385] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000 <4> [87.265387] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.265388] CR2: 00005a59bd37a758 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [87.265390] PKRU: 55555554 <4> [87.265391] Call Trace: <4> [87.265392] <TASK> <4> [87.265396] ? lock_acquire+0xc4/0x2f0 <4> [87.265401] ? lock_release+0xd0/0x2b0 <4> [87.265406] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.265412] process_one_work+0x239/0x760 <4> [87.265418] worker_thread+0x200/0x3f0 <4> [87.265421] ? __pfx_worker_thread+0x10/0x10 <4> [87.265423] kthread+0x10d/0x150 <4> [87.265426] ? __pfx_kthread+0x10/0x10 <4> [87.265430] ret_from_fork+0x3d4/0x480 <4> [87.265432] ? __pfx_kthread+0x10/0x10 <4> [87.265435] ret_from_fork_asm+0x1a/0x30 <4> [87.265442] </TASK> <4> [87.265444] irq event stamp: 1232945 <4> [87.265445] hardirqs last enabled at (1232951): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.265448] hardirqs last disabled at (1232956): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.265450] softirqs last enabled at (1232090): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.265452] softirqs last disabled at (1232079): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.265454] ---[ end trace 0000000000000000 ]--- <7> [87.265977] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [87.266141] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [87.266398] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4139, lrc_seqno=4139, guc_id=0, flags=0x73 in no process [-1] <7> [87.266405] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.266505] ------------[ cut here ]------------ <4> [87.266507] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.266510] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#6: kworker/u64:1/120 <4> [87.266623] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.266750] efi_pstore nfnetlink autofs4 <4> [87.266757] CPU: 6 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.266762] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.266764] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.266766] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.266775] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.266885] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.266888] RSP: 0018:ffffc9000055bc98 EFLAGS: 00010246 <4> [87.266892] RAX: ffffffffa120354b RBX: ffff8881747bfb40 RCX: 0000000000000000 <4> [87.266894] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.266896] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.266899] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.266901] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.266904] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [87.266906] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.266909] CR2: 000075ce18fae000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [87.266912] PKRU: 55555554 <4> [87.266914] Call Trace: <4> [87.266916] <TASK> <4> [87.266924] ? lock_acquire+0xc4/0x2f0 <4> [87.266932] ? lock_release+0xd0/0x2b0 <4> [87.266942] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.266952] process_one_work+0x239/0x760 <4> [87.266971] worker_thread+0x200/0x3f0 <4> [87.266976] ? __pfx_worker_thread+0x10/0x10 <4> [87.266981] kthread+0x10d/0x150 <4> [87.267008] ? __pfx_kthread+0x10/0x10 <4> [87.267014] ret_from_fork+0x3d4/0x480 <4> [87.267017] ? __pfx_kthread+0x10/0x10 <4> [87.267023] ret_from_fork_asm+0x1a/0x30 <4> [87.267036] </TASK> <4> [87.267038] irq event stamp: 389711 <4> [87.267040] hardirqs last enabled at (389717): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.267045] hardirqs last disabled at (389722): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.267049] softirqs last enabled at (389662): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.267053] softirqs last disabled at (389655): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.267056] ---[ end trace 0000000000000000 ]--- <6> [87.267060] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [87.267168] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [87.267178] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [87.267257] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [87.267469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [87.267562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [87.267656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [87.267745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [87.267832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [87.267918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [87.268023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [87.268110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [87.268194] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [87.268290] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [87.268406] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [87.269435] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [87.279965] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [87.280238] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [87.281398] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [87.281480] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [87.281558] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [87.281635] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [87.281710] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [87.281786] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [87.281860] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [87.281933] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [87.282030] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [87.282103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [87.282177] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [87.282250] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [87.282323] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [87.282397] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [87.282470] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [87.282543] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [87.282619] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [87.282697] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [87.282772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [87.282855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [87.282938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [87.283031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [87.283111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [87.283190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [87.283272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [87.283352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [87.283430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [87.283511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [87.283591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [87.283669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [87.283749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [87.283832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [87.283918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [87.284012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [87.284097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [87.284177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [87.284255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [87.284331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [87.284410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [87.284490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [87.284573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [87.284652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [87.284729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [87.284806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [87.284887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [87.284967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [87.285049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [87.285129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [87.285209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [87.285287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [87.285362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [87.285442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [87.285518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [87.285596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [87.285672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [87.285749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [87.285825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [87.285899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [87.285988] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [87.286119] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [87.286123] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4139, lrc_seqno=4139, guc_id=0, flags=0x73 in no process [-1] <7> [87.286125] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.286184] ------------[ cut here ]------------ <4> [87.286185] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.286187] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#4: kworker/u64:0/12 <4> [87.286259] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.286323] efi_pstore nfnetlink autofs4 <4> [87.286328] CPU: 4 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.286331] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.286332] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.286334] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.286339] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.286409] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.286410] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [87.286412] RAX: ffffffffa120354b RBX: ffff8881747bfb40 RCX: 0000000000000000 <4> [87.286414] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.286415] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.286417] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.286418] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.286419] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [87.286421] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.286422] CR2: 000071186c9e62f4 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [87.286424] PKRU: 55555554 <4> [87.286425] Call Trace: <4> [87.286426] <TASK> <4> [87.286430] ? lock_acquire+0xc4/0x2f0 <4> [87.286435] ? lock_release+0xd0/0x2b0 <4> [87.286442] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.286448] process_one_work+0x239/0x760 <4> [87.286454] worker_thread+0x200/0x3f0 <4> [87.286457] ? __pfx_worker_thread+0x10/0x10 <4> [87.286459] kthread+0x10d/0x150 <4> [87.286462] ? __pfx_kthread+0x10/0x10 <4> [87.286466] ret_from_fork+0x3d4/0x480 <4> [87.286468] ? __pfx_kthread+0x10/0x10 <4> [87.286471] ret_from_fork_asm+0x1a/0x30 <4> [87.286478] </TASK> <4> [87.286479] irq event stamp: 1238443 <4> [87.286481] hardirqs last enabled at (1238449): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.286483] hardirqs last disabled at (1238454): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.286486] softirqs last enabled at (1237600): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.286488] softirqs last disabled at (1237589): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.286490] ---[ end trace 0000000000000000 ]--- <6> [87.286492] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [87.286561] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [87.286567] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [87.286974] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [87.287174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [87.287261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [87.287354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [87.287441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [87.287527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [87.287614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [87.287702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [87.287790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [87.287873] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [87.287972] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [87.288089] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [87.289097] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [87.299820] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [87.300069] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [87.301369] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [87.301447] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [87.301522] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [87.301598] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [87.301673] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [87.301748] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [87.301824] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [87.301900] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [87.301982] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [87.302057] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [87.302135] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [87.302211] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [87.302288] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [87.302363] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [87.302438] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [87.302511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [87.302584] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [87.302658] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [87.302731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [87.302812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [87.302896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [87.302984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [87.303065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [87.303143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [87.303220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [87.303300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [87.303382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [87.303465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [87.303546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [87.303625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [87.303704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [87.303783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [87.303867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [87.303954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [87.304038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [87.304119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [87.304199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [87.304276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [87.304357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [87.304436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [87.304518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [87.304596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [87.304674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [87.304753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [87.304836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [87.304915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [87.305004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [87.305080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [87.305161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [87.305240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [87.305318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [87.305398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [87.305476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [87.305553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [87.305633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [87.305713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [87.305790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [87.305866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [87.305945] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [87.306071] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [87.306075] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4139, lrc_seqno=4139, guc_id=0, flags=0x73 in no process [-1] <7> [87.306078] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.306136] ------------[ cut here ]------------ <4> [87.306137] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.306139] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#4: kworker/u64:0/12 <4> [87.306210] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.306273] efi_pstore nfnetlink autofs4 <4> [87.306278] CPU: 4 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.306280] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.306281] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.306283] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.306288] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.306356] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.306358] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [87.306360] RAX: ffffffffa120354b RBX: ffff8881747bfb40 RCX: 0000000000000000 <4> [87.306362] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.306363] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.306364] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.306365] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.306367] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [87.306368] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.306370] CR2: 000071186c9e62f4 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [87.306371] PKRU: 55555554 <4> [87.306372] Call Trace: <4> [87.306373] <TASK> <4> [87.306377] ? lock_acquire+0xc4/0x2f0 <4> [87.306382] ? lock_release+0xd0/0x2b0 <4> [87.306387] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.306392] process_one_work+0x239/0x760 <4> [87.306398] worker_thread+0x200/0x3f0 <4> [87.306401] ? __pfx_worker_thread+0x10/0x10 <4> [87.306404] kthread+0x10d/0x150 <4> [87.306406] ? __pfx_kthread+0x10/0x10 <4> [87.306410] ret_from_fork+0x3d4/0x480 <4> [87.306412] ? __pfx_kthread+0x10/0x10 <4> [87.306415] ret_from_fork_asm+0x1a/0x30 <4> [87.306423] </TASK> <4> [87.306424] irq event stamp: 1241553 <4> [87.306425] hardirqs last enabled at (1241559): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.306428] hardirqs last disabled at (1241564): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.306430] softirqs last enabled at (1240718): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.306432] softirqs last disabled at (1240711): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.306434] ---[ end trace 0000000000000000 ]--- <5> [87.308169] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4194, lrc_seqno=4194, guc_id=0, flags=0x73 in no process [-1] <7> [87.308176] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [87.308180] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [87.308275] ------------[ cut here ]------------ <4> [87.308277] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.308279] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#6: kworker/u64:1/120 <7> [87.308288] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [87.308394] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.308522] efi_pstore nfnetlink autofs4 <4> [87.308530] CPU: 6 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.308535] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.308537] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.308539] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.308548] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.308657] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.308660] RSP: 0018:ffffc9000055bc98 EFLAGS: 00010246 <4> [87.308665] RAX: ffffffffa120354b RBX: ffff88817483e640 RCX: 0000000000000000 <4> [87.308667] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.308670] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.308672] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.308675] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.308677] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [87.308680] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.308683] CR2: 000075ce18fae000 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [87.308685] PKRU: 55555554 <4> [87.308688] Call Trace: <4> [87.308690] <TASK> <4> [87.308698] ? lock_acquire+0xc4/0x2f0 <4> [87.308707] ? lock_release+0xd0/0x2b0 <4> [87.308716] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.308726] process_one_work+0x239/0x760 <4> [87.308737] worker_thread+0x200/0x3f0 <4> [87.308742] ? __pfx_worker_thread+0x10/0x10 <4> [87.308746] kthread+0x10d/0x150 <4> [87.308751] ? __pfx_kthread+0x10/0x10 <4> [87.308757] ret_from_fork+0x3d4/0x480 <4> [87.308760] ? __pfx_kthread+0x10/0x10 <4> [87.308766] ret_from_fork_asm+0x1a/0x30 <4> [87.308779] </TASK> <4> [87.308781] irq event stamp: 391099 <4> [87.308783] hardirqs last enabled at (391105): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.308788] hardirqs last disabled at (391110): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.308791] softirqs last enabled at (390120): [<ffffffff8133ac13>] kernel_fpu_end+0x53/0x70 <4> [87.308795] softirqs last disabled at (390118): [<ffffffff8133b324>] kernel_fpu_begin_mask+0xc4/0x120 <4> [87.308799] ---[ end trace 0000000000000000 ]--- <6> [87.308803] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [87.308913] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [87.308922] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [87.308990] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [87.309252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [87.309390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [87.309529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [87.309663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [87.309796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [87.309927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [87.310093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [87.310228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [87.310358] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [87.310500] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [87.310666] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [87.312074] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [87.321957] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [87.322269] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [87.323433] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [87.323555] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [87.323674] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [87.323795] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [87.323915] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [87.324116] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [87.324238] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [87.324358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [87.324478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [87.324598] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [87.324718] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [87.324838] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [87.325117] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [87.325239] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [87.325360] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [87.325480] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [87.325600] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [87.325720] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [87.325840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [87.325977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [87.326066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [87.326151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [87.326236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [87.326319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [87.326401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [87.326480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [87.326557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [87.326637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [87.326718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [87.326801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [87.326885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [87.326972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [87.327060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [87.327144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [87.327228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [87.327309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [87.327389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [87.327466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [87.327542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [87.327623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [87.327707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [87.327787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [87.327866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [87.327943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [87.328051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [87.328129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [87.328209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [87.328290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [87.328370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [87.328448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [87.328524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [87.328604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [87.328680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [87.328756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [87.328831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [87.328912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [87.329000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [87.329077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [87.329158] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [87.329270] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [87.329275] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4194, lrc_seqno=4194, guc_id=0, flags=0x73 in no process [-1] <7> [87.329277] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.329335] ------------[ cut here ]------------ <4> [87.329336] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.329338] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#4: kworker/u64:1/120 <4> [87.329409] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.329474] efi_pstore nfnetlink autofs4 <4> [87.329478] CPU: 4 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.329481] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.329482] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.329484] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.329489] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.329558] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.329560] RSP: 0018:ffffc9000055bc98 EFLAGS: 00010246 <4> [87.329562] RAX: ffffffffa120354b RBX: ffff88817483e640 RCX: 0000000000000000 <4> [87.329563] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.329565] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.329566] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.329567] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.329568] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [87.329570] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.329571] CR2: 000071186c9e62f4 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [87.329573] PKRU: 55555554 <4> [87.329574] Call Trace: <4> [87.329575] <TASK> <4> [87.329579] ? lock_acquire+0xc4/0x2f0 <4> [87.329584] ? lock_release+0xd0/0x2b0 <4> [87.329589] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.329595] process_one_work+0x239/0x760 <4> [87.329601] worker_thread+0x200/0x3f0 <4> [87.329604] ? __pfx_worker_thread+0x10/0x10 <4> [87.329606] kthread+0x10d/0x150 <4> [87.329609] ? __pfx_kthread+0x10/0x10 <4> [87.329613] ret_from_fork+0x3d4/0x480 <4> [87.329615] ? __pfx_kthread+0x10/0x10 <4> [87.329618] ret_from_fork_asm+0x1a/0x30 <4> [87.329625] </TASK> <4> [87.329626] irq event stamp: 394705 <4> [87.329627] hardirqs last enabled at (394711): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.329630] hardirqs last disabled at (394716): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.329632] softirqs last enabled at (393850): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.329635] softirqs last disabled at (393843): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.329637] ---[ end trace 0000000000000000 ]--- <6> [87.329639] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [87.329709] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [87.329715] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [87.331010] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [87.331111] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [87.331218] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [87.331421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [87.331510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [87.331603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [87.331690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [87.331777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [87.331862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [87.331951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [87.332037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [87.332119] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [87.332215] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [87.332331] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [87.333337] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [87.343949] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [87.344199] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [87.345238] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [87.345318] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [87.345395] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [87.345472] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [87.345548] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [87.345623] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [87.345697] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [87.345771] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [87.345845] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [87.345920] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [87.346002] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [87.346076] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [87.346149] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [87.346223] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [87.346300] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [87.346378] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [87.346456] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [87.346531] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [87.346605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [87.346688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [87.346769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [87.346849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [87.346930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [87.347024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [87.347103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [87.347181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [87.347259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [87.347339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [87.347419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [87.347498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [87.347576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [87.347655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [87.347740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [87.347824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [87.347908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [87.347997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [87.348077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [87.348155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [87.348232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [87.348309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [87.348389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [87.348468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [87.348549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [87.348628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [87.348711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [87.348790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [87.348872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [87.348955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [87.349036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [87.349113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [87.349190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [87.349269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [87.349346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [87.349423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [87.349500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [87.349581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [87.349660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [87.349738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [87.349817] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [87.349927] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [87.349931] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4194, lrc_seqno=4194, guc_id=0, flags=0x73 in no process [-1] <7> [87.349933] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.350013] ------------[ cut here ]------------ <4> [87.350014] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.350016] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#4: kworker/u64:1/120 <4> [87.350088] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.350152] efi_pstore nfnetlink autofs4 <4> [87.350156] CPU: 4 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.350159] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.350160] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.350162] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.350167] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.350237] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.350239] RSP: 0018:ffffc9000055bc98 EFLAGS: 00010246 <4> [87.350241] RAX: ffffffffa120354b RBX: ffff88817483e640 RCX: 0000000000000000 <4> [87.350243] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.350244] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.350245] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.350247] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.350248] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [87.350250] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.350251] CR2: 000071186c9e62f4 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [87.350253] PKRU: 55555554 <4> [87.350254] Call Trace: <4> [87.350255] <TASK> <4> [87.350259] ? lock_acquire+0xc4/0x2f0 <4> [87.350264] ? lock_release+0xd0/0x2b0 <4> [87.350269] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.350275] process_one_work+0x239/0x760 <4> [87.350281] worker_thread+0x200/0x3f0 <4> [87.350284] ? __pfx_worker_thread+0x10/0x10 <4> [87.350286] kthread+0x10d/0x150 <4> [87.350289] ? __pfx_kthread+0x10/0x10 <4> [87.350293] ret_from_fork+0x3d4/0x480 <4> [87.350295] ? __pfx_kthread+0x10/0x10 <4> [87.350298] ret_from_fork_asm+0x1a/0x30 <4> [87.350305] </TASK> <4> [87.350307] irq event stamp: 397841 <4> [87.350308] hardirqs last enabled at (397847): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.350311] hardirqs last disabled at (397852): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.350313] softirqs last enabled at (396926): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.350315] softirqs last disabled at (396919): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.350317] ---[ end trace 0000000000000000 ]--- <7> [87.351828] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <5> [87.351919] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4249, lrc_seqno=4249, guc_id=0, flags=0x73 in no process [-1] <7> [87.351922] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [87.351944] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [87.352003] ------------[ cut here ]------------ <4> [87.352004] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.352005] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#8: kworker/u64:0/12 <4> [87.352078] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.352142] efi_pstore nfnetlink autofs4 <4> [87.352147] CPU: 8 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.352150] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.352151] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.352152] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.352157] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.352226] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.352227] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [87.352229] RAX: ffffffffa120354b RBX: ffff88817488fb40 RCX: 0000000000000000 <4> [87.352231] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.352232] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.352233] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.352235] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.352236] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [87.352237] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.352239] CR2: 000075ce18fb0000 CR3: 000000012bf77006 CR4: 0000000000f72ef0 <4> [87.352240] PKRU: 55555554 <4> [87.352241] Call Trace: <4> [87.352242] <TASK> <4> [87.352246] ? lock_acquire+0xc4/0x2f0 <4> [87.352251] ? lock_release+0xd0/0x2b0 <4> [87.352256] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.352262] process_one_work+0x239/0x760 <4> [87.352267] worker_thread+0x200/0x3f0 <4> [87.352270] ? __pfx_worker_thread+0x10/0x10 <4> [87.352273] kthread+0x10d/0x150 <4> [87.352276] ? __pfx_kthread+0x10/0x10 <4> [87.352279] ret_from_fork+0x3d4/0x480 <4> [87.352281] ? __pfx_kthread+0x10/0x10 <4> [87.352284] ret_from_fork_asm+0x1a/0x30 <4> [87.352292] </TASK> <4> [87.352293] irq event stamp: 1247791 <4> [87.352294] hardirqs last enabled at (1247797): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.352297] hardirqs last disabled at (1247802): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.352299] softirqs last enabled at (1246518): [<ffffffff8133ac13>] kernel_fpu_end+0x53/0x70 <4> [87.352301] softirqs last disabled at (1246516): [<ffffffff8133b324>] kernel_fpu_begin_mask+0xc4/0x120 <4> [87.352304] ---[ end trace 0000000000000000 ]--- <6> [87.352306] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [87.352376] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [87.352383] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [87.352430] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [87.352632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [87.352720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [87.352812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [87.352899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [87.352994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [87.353080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [87.353168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [87.353259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [87.353344] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [87.353440] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [87.353556] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [87.354564] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [87.364943] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [87.365193] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [87.366189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [87.366268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [87.366345] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [87.366422] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [87.366498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [87.366574] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [87.366647] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [87.366722] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [87.366795] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [87.366870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [87.366951] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [87.367028] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [87.367101] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [87.367175] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [87.367248] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [87.367322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [87.367396] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [87.367469] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [87.367542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [87.367625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [87.367706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [87.367788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [87.367872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [87.367954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [87.368032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [87.368109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [87.368186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [87.368265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [87.368344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [87.368422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [87.368501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [87.368581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [87.368668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [87.368755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [87.368842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [87.368926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [87.369020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [87.369099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [87.369178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [87.369257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [87.369337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [87.369416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [87.369497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [87.369577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [87.369661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [87.369739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [87.369818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [87.369895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [87.369981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [87.370057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [87.370134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [87.370214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [87.370296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [87.370378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [87.370457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [87.370536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [87.370613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [87.370690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [87.370772] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [87.370882] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [87.370886] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4249, lrc_seqno=4249, guc_id=0, flags=0x73 in no process [-1] <7> [87.370888] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.371800] ------------[ cut here ]------------ <4> [87.371802] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.371803] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#8: kworker/u64:0/12 <4> [87.371878] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.371948] efi_pstore nfnetlink autofs4 <4> [87.371952] CPU: 8 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.371955] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.371957] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.371958] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.371963] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.372034] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.372036] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [87.372038] RAX: ffffffffa120354b RBX: ffff88817488fb40 RCX: 0000000000000000 <4> [87.372040] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.372041] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.372042] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.372043] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.372045] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [87.372046] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.372048] CR2: 000075ce18fb0000 CR3: 000000012bf77006 CR4: 0000000000f72ef0 <4> [87.372049] PKRU: 55555554 <4> [87.372050] Call Trace: <4> [87.372052] <TASK> <4> [87.372056] ? lock_acquire+0xc4/0x2f0 <4> [87.372060] ? lock_release+0xd0/0x2b0 <4> [87.372065] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.372071] process_one_work+0x239/0x760 <4> [87.372077] worker_thread+0x200/0x3f0 <4> [87.372079] ? __pfx_worker_thread+0x10/0x10 <4> [87.372082] kthread+0x10d/0x150 <4> [87.372085] ? __pfx_kthread+0x10/0x10 <4> [87.372088] ret_from_fork+0x3d4/0x480 <4> [87.372090] ? __pfx_kthread+0x10/0x10 <4> [87.372093] ret_from_fork_asm+0x1a/0x30 <4> [87.372101] </TASK> <4> [87.372102] irq event stamp: 1250887 <4> [87.372103] hardirqs last enabled at (1250893): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.372106] hardirqs last disabled at (1250898): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.372108] softirqs last enabled at (1250598): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.372110] softirqs last disabled at (1250591): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.372113] ---[ end trace 0000000000000000 ]--- <7> [87.372127] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [87.372230] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [87.372329] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [87.372399] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [87.372405] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [87.372811] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [87.373016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [87.373105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [87.373197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [87.373286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [87.373373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [87.373459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [87.373544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [87.373631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [87.373712] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [87.373806] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [87.373921] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [87.374941] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [87.384939] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [87.385185] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [87.386168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [87.386246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [87.386321] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [87.386399] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [87.386476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [87.386551] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [87.386624] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [87.386698] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [87.386771] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [87.386844] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [87.386917] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [87.387003] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [87.387078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [87.387154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [87.387231] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [87.387306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [87.387380] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [87.387454] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [87.387528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [87.387608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [87.387688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [87.387767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [87.387847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [87.387925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [87.388020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [87.388100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [87.388177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [87.388257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [87.388335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [87.388413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [87.388491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [87.388570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [87.388655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [87.388738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [87.388822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [87.388902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [87.388990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [87.389067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [87.389143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [87.389219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [87.389298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [87.389376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [87.389453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [87.389531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [87.389615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [87.389694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [87.389773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [87.389853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [87.389937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [87.390015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [87.390091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [87.390172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [87.390250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [87.390327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [87.390402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [87.390480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [87.390555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [87.390629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [87.390707] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [87.390816] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [87.390820] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4249, lrc_seqno=4249, guc_id=0, flags=0x73 in no process [-1] <7> [87.390822] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.390880] ------------[ cut here ]------------ <4> [87.390881] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.390883] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#8: kworker/u64:0/12 <4> [87.390959] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.391024] efi_pstore nfnetlink autofs4 <4> [87.391029] CPU: 8 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.391031] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.391032] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.391034] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.391039] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.391107] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.391109] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [87.391111] RAX: ffffffffa120354b RBX: ffff88817488fb40 RCX: 0000000000000000 <4> [87.391113] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.391114] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.391115] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.391116] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.391118] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [87.391119] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.391121] CR2: 000075ce18fb0000 CR3: 000000012bf77006 CR4: 0000000000f72ef0 <4> [87.391122] PKRU: 55555554 <4> [87.391123] Call Trace: <4> [87.391124] <TASK> <4> [87.391128] ? lock_acquire+0xc4/0x2f0 <4> [87.391133] ? lock_release+0xd0/0x2b0 <4> [87.391138] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.391143] process_one_work+0x239/0x760 <4> [87.391149] worker_thread+0x200/0x3f0 <4> [87.391152] ? __pfx_worker_thread+0x10/0x10 <4> [87.391154] kthread+0x10d/0x150 <4> [87.391157] ? __pfx_kthread+0x10/0x10 <4> [87.391161] ret_from_fork+0x3d4/0x480 <4> [87.391163] ? __pfx_kthread+0x10/0x10 <4> [87.391166] ret_from_fork_asm+0x1a/0x30 <4> [87.391174] </TASK> <4> [87.391175] irq event stamp: 1253991 <4> [87.391176] hardirqs last enabled at (1253997): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.391179] hardirqs last disabled at (1254002): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.391181] softirqs last enabled at (1252900): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.391184] softirqs last disabled at (1252891): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.391186] ---[ end trace 0000000000000000 ]--- <7> [87.392204] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [87.392311] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [87.392553] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4304, lrc_seqno=4304, guc_id=0, flags=0x73 in no process [-1] <7> [87.392556] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.392619] ------------[ cut here ]------------ <4> [87.392620] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.392621] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#4: kworker/u64:1/120 <4> [87.392695] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.392759] efi_pstore nfnetlink autofs4 <4> [87.392763] CPU: 4 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.392766] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.392767] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.392768] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.392773] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.392843] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.392844] RSP: 0018:ffffc9000055bc98 EFLAGS: 00010246 <4> [87.392847] RAX: ffffffffa120354b RBX: ffff888174910940 RCX: 0000000000000000 <4> [87.392848] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.392849] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.392851] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.392852] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.392853] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [87.392855] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.392856] CR2: 000071186c9e62f4 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [87.392857] PKRU: 55555554 <4> [87.392859] Call Trace: <4> [87.392860] <TASK> <4> [87.392864] ? lock_acquire+0xc4/0x2f0 <4> [87.392868] ? lock_release+0xd0/0x2b0 <4> [87.392873] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.392879] process_one_work+0x239/0x760 <4> [87.392885] worker_thread+0x200/0x3f0 <4> [87.392888] ? __pfx_worker_thread+0x10/0x10 <4> [87.392890] kthread+0x10d/0x150 <4> [87.392893] ? __pfx_kthread+0x10/0x10 <4> [87.392897] ret_from_fork+0x3d4/0x480 <4> [87.392899] ? __pfx_kthread+0x10/0x10 <4> [87.392902] ret_from_fork_asm+0x1a/0x30 <4> [87.392909] </TASK> <4> [87.392910] irq event stamp: 402299 <4> [87.392912] hardirqs last enabled at (402305): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.392914] hardirqs last disabled at (402310): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.392917] softirqs last enabled at (399898): [<ffffffff8133ac13>] kernel_fpu_end+0x53/0x70 <4> [87.392919] softirqs last disabled at (399896): [<ffffffff8133b324>] kernel_fpu_begin_mask+0xc4/0x120 <4> [87.392921] ---[ end trace 0000000000000000 ]--- <6> [87.392923] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [87.393011] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [87.393018] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [87.393083] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [87.393292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [87.393387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [87.393480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [87.393569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [87.393655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [87.393741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [87.393827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [87.393915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [87.394018] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [87.394114] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [87.394232] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [87.395243] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [87.405935] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [87.406189] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [87.407172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [87.407251] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [87.407327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [87.407403] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [87.407479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [87.407554] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [87.407629] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [87.407706] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [87.407783] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [87.407859] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [87.407945] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [87.408019] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [87.408093] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [87.408167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [87.408241] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [87.408314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [87.408387] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [87.408459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [87.408531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [87.408613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [87.408694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [87.408774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [87.408856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [87.408943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [87.409023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [87.409100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [87.409177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [87.409256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [87.409336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [87.409415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [87.409496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [87.409579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [87.409665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [87.409750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [87.409836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [87.409917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [87.410015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [87.410093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [87.410170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [87.410246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [87.410325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [87.410408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [87.410489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [87.410569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [87.410652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [87.410730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [87.410808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [87.410884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [87.410973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [87.411053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [87.411132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [87.411231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [87.411360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [87.411471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [87.411578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [87.411685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [87.411787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [87.411891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [87.412019] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [87.412158] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [87.412163] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4304, lrc_seqno=4304, guc_id=0, flags=0x73 in no process [-1] <7> [87.412166] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.412226] ------------[ cut here ]------------ <4> [87.412227] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.412228] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#0: kworker/u64:0/12 <4> [87.412301] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.412366] efi_pstore nfnetlink autofs4 <4> [87.412370] CPU: 0 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.412373] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.412374] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.412376] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.412381] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.412452] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.412453] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [87.412455] RAX: ffffffffa120354b RBX: ffff888174910940 RCX: 0000000000000000 <4> [87.412457] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.412458] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.412460] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.412461] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.412462] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [87.412464] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.412465] CR2: 00007724b3cbd4b0 CR3: 000000012bf77005 CR4: 0000000000f72ef0 <4> [87.412467] PKRU: 55555554 <4> [87.412468] Call Trace: <4> [87.412469] <TASK> <4> [87.412473] ? lock_acquire+0xc4/0x2f0 <4> [87.412478] ? lock_release+0xd0/0x2b0 <4> [87.412483] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.412489] process_one_work+0x239/0x760 <4> [87.412495] worker_thread+0x200/0x3f0 <4> [87.412498] ? __pfx_worker_thread+0x10/0x10 <4> [87.412500] kthread+0x10d/0x150 <4> [87.412503] ? __pfx_kthread+0x10/0x10 <4> [87.412507] ret_from_fork+0x3d4/0x480 <4> [87.412509] ? __pfx_kthread+0x10/0x10 <4> [87.412512] ret_from_fork_asm+0x1a/0x30 <4> [87.412520] </TASK> <4> [87.412521] irq event stamp: 1259321 <4> [87.412522] hardirqs last enabled at (1259327): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.412525] hardirqs last disabled at (1259332): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.412527] softirqs last enabled at (1258478): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.412530] softirqs last disabled at (1258467): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.412532] ---[ end trace 0000000000000000 ]--- <6> [87.412534] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [87.412605] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [87.412611] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [87.413907] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [87.414031] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [87.414139] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [87.414343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [87.414431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [87.414525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [87.414614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [87.414702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [87.414789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [87.414876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [87.414974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [87.415060] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [87.415156] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [87.415274] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [87.416283] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [87.427269] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [87.427511] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [87.428469] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [87.428541] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [87.428610] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [87.428680] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [87.428751] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [87.428823] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [87.428894] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [87.428978] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [87.429051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [87.429120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [87.429188] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [87.429262] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [87.429334] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [87.429401] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [87.429468] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [87.429537] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [87.429607] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [87.429676] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [87.429745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [87.429820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [87.429895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [87.429979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [87.430059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [87.430138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [87.430208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [87.430283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [87.430355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [87.430429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [87.430501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [87.430572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [87.430644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [87.430716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [87.430793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [87.430870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [87.430956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [87.431037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [87.431112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [87.431183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [87.431255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [87.431326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [87.431404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [87.431478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [87.431552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [87.431622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [87.431697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [87.431768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [87.431839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [87.431909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [87.431999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [87.432079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [87.432156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [87.432230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [87.432300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [87.432372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [87.432442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [87.432513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [87.432582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [87.432654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [87.432730] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [87.432834] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [87.432838] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4304, lrc_seqno=4304, guc_id=0, flags=0x73 in no process [-1] <7> [87.432841] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.432894] ------------[ cut here ]------------ <4> [87.432895] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.432896] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#0: kworker/u64:0/12 <4> [87.432976] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.433040] efi_pstore nfnetlink autofs4 <4> [87.433044] CPU: 0 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.433047] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.433049] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.433050] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.433055] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.433126] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.433128] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [87.433130] RAX: ffffffffa120354b RBX: ffff888174910940 RCX: 0000000000000000 <4> [87.433131] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.433132] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.433134] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.433135] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.433136] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [87.433139] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.433140] CR2: 00007724b3cbd4b0 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [87.433141] PKRU: 55555554 <4> [87.433142] Call Trace: <4> [87.433143] <TASK> <4> [87.433147] ? lock_acquire+0xc4/0x2f0 <4> [87.433151] ? lock_release+0xd0/0x2b0 <4> [87.433156] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.433161] process_one_work+0x239/0x760 <4> [87.433167] worker_thread+0x200/0x3f0 <4> [87.433169] ? __pfx_worker_thread+0x10/0x10 <4> [87.433171] kthread+0x10d/0x150 <4> [87.433174] ? __pfx_kthread+0x10/0x10 <4> [87.433177] ret_from_fork+0x3d4/0x480 <4> [87.433179] ? __pfx_kthread+0x10/0x10 <4> [87.433182] ret_from_fork_asm+0x1a/0x30 <4> [87.433188] </TASK> <4> [87.433190] irq event stamp: 1262445 <4> [87.433191] hardirqs last enabled at (1262451): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.433193] hardirqs last disabled at (1262456): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.433195] softirqs last enabled at (1261702): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.433198] softirqs last disabled at (1261691): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.433200] ---[ end trace 0000000000000000 ]--- <5> [87.433807] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4359, lrc_seqno=4359, guc_id=0, flags=0x73 in no process [-1] <7> [87.433813] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.434005] ------------[ cut here ]------------ <4> [87.434008] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.434011] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#12: kworker/u64:5/204 <4> [87.434135] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.434237] efi_pstore nfnetlink autofs4 <4> [87.434244] CPU: 12 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.434249] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.434251] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.434254] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.434264] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.434381] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.434384] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [87.434387] RAX: ffffffffa120354b RBX: ffff8881749e8c40 RCX: 0000000000000000 <4> [87.434390] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.434391] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.434393] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.434396] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.434398] FS: 0000000000000000(0000) GS:ffff8888db297000(0000) knlGS:0000000000000000 <4> [87.434400] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.434402] CR2: 000075ce18fb1000 CR3: 000000012bf77001 CR4: 0000000000f72ef0 <4> [87.434404] PKRU: 55555554 <4> [87.434406] Call Trace: <4> [87.434408] <TASK> <4> [87.434415] ? lock_acquire+0xc4/0x2f0 <4> [87.434425] ? lock_release+0xd0/0x2b0 <4> [87.434434] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.434444] process_one_work+0x239/0x760 <4> [87.434455] worker_thread+0x200/0x3f0 <4> [87.434459] ? __pfx_worker_thread+0x10/0x10 <4> [87.434463] kthread+0x10d/0x150 <4> [87.434467] ? __pfx_kthread+0x10/0x10 <4> [87.434473] ret_from_fork+0x3d4/0x480 <4> [87.434476] ? __pfx_kthread+0x10/0x10 <4> [87.434481] ret_from_fork_asm+0x1a/0x30 <4> [87.434495] </TASK> <4> [87.434497] irq event stamp: 426887 <4> [87.434500] hardirqs last enabled at (426893): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.434504] hardirqs last disabled at (426898): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.434507] softirqs last enabled at (426126): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.434511] softirqs last disabled at (426121): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.434515] ---[ end trace 0000000000000000 ]--- <6> [87.434519] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [87.434636] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [87.434644] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [87.434701] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [87.434803] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [87.434911] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [87.435137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [87.435228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [87.435321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [87.435410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [87.435498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [87.435583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [87.435669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [87.435760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [87.435844] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [87.435944] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [87.436061] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [87.437070] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [87.446927] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [87.447176] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [87.448162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [87.448234] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [87.448304] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [87.448375] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [87.448446] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [87.448515] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [87.448583] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [87.448652] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [87.448720] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [87.448791] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [87.448861] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [87.448935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [87.449010] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [87.449081] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [87.449148] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [87.449216] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [87.449283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [87.449350] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [87.449418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [87.449491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [87.449565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [87.449637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [87.449711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [87.449785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [87.449856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [87.449933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [87.450010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [87.450087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [87.450160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [87.450230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [87.450300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [87.450376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [87.450456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [87.450534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [87.450612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [87.450686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [87.450758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [87.450828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [87.450897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [87.450984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [87.451064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [87.451142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [87.451212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [87.451280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [87.451356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [87.451429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [87.451501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [87.451570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [87.451641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [87.451711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [87.451780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [87.451851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [87.451922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [87.451998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [87.452074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [87.452145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [87.452214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [87.452282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [87.452359] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [87.452463] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [87.452466] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4359, lrc_seqno=4359, guc_id=0, flags=0x73 in no process [-1] <7> [87.452469] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.452523] ------------[ cut here ]------------ <4> [87.452524] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.452525] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#0: kworker/u64:0/12 <4> [87.452590] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.452649] efi_pstore nfnetlink autofs4 <4> [87.452653] CPU: 0 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.452655] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.452657] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.452658] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.452662] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.452725] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.452727] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [87.452729] RAX: ffffffffa120354b RBX: ffff8881749e8c40 RCX: 0000000000000000 <4> [87.452730] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.452731] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.452732] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.452733] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.452735] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [87.452736] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.452737] CR2: 00007724b3cbd4b0 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [87.452739] PKRU: 55555554 <4> [87.452740] Call Trace: <4> [87.452740] <TASK> <4> [87.452744] ? lock_acquire+0xc4/0x2f0 <4> [87.452748] ? lock_release+0xd0/0x2b0 <4> [87.452753] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.452758] process_one_work+0x239/0x760 <4> [87.452764] worker_thread+0x200/0x3f0 <4> [87.452767] ? __pfx_worker_thread+0x10/0x10 <4> [87.452769] kthread+0x10d/0x150 <4> [87.452772] ? __pfx_kthread+0x10/0x10 <4> [87.452775] ret_from_fork+0x3d4/0x480 <4> [87.452777] ? __pfx_kthread+0x10/0x10 <4> [87.452780] ret_from_fork_asm+0x1a/0x30 <4> [87.452787] </TASK> <4> [87.452788] irq event stamp: 1267487 <4> [87.452789] hardirqs last enabled at (1267493): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.452792] hardirqs last disabled at (1267498): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.452794] softirqs last enabled at (1266404): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.452796] softirqs last disabled at (1266397): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.452798] ---[ end trace 0000000000000000 ]--- <6> [87.452800] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [87.452863] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [87.452869] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [87.453042] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [87.453241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [87.453326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [87.453416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [87.453503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [87.453591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [87.453680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [87.453769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [87.453857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [87.453948] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [87.454043] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [87.454161] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [87.455170] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [87.464921] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [87.465170] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [87.466191] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [87.466269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [87.466345] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [87.466422] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [87.466498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [87.466575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [87.466651] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [87.466727] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [87.466802] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [87.466880] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [87.466971] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [87.467049] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [87.467124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [87.467199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [87.467273] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [87.467347] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [87.467422] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [87.467499] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [87.467575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [87.467659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [87.467741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [87.467821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [87.467902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [87.467992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [87.468069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [87.468145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [87.468222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [87.468306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [87.468390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [87.468470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [87.468550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [87.468630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [87.468715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [87.468799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [87.468882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [87.468970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [87.469053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [87.469135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [87.469214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [87.469292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [87.469371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [87.469450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [87.469531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [87.469609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [87.469691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [87.469769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [87.469847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [87.469931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [87.470008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [87.470084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [87.470160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [87.470239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [87.470315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [87.470392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [87.470467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [87.470544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [87.470619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [87.470694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [87.470777] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [87.470887] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [87.470890] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4359, lrc_seqno=4359, guc_id=0, flags=0x73 in no process [-1] <7> [87.470893] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.471818] ------------[ cut here ]------------ <4> [87.471820] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.471821] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#0: kworker/u64:0/12 <4> [87.471896] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.471967] efi_pstore nfnetlink autofs4 <4> [87.471971] CPU: 0 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.471974] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.471975] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.471977] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.471982] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.472051] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.472053] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [87.472055] RAX: ffffffffa120354b RBX: ffff8881749e8c40 RCX: 0000000000000000 <4> [87.472057] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.472058] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.472059] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.472060] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.472062] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [87.472063] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.472065] CR2: 00007724b3cbd4b0 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [87.472066] PKRU: 55555554 <4> [87.472067] Call Trace: <4> [87.472068] <TASK> <4> [87.472073] ? lock_acquire+0xc4/0x2f0 <4> [87.472077] ? lock_release+0xd0/0x2b0 <4> [87.472082] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.472088] process_one_work+0x239/0x760 <4> [87.472094] worker_thread+0x200/0x3f0 <4> [87.472097] ? __pfx_worker_thread+0x10/0x10 <4> [87.472099] kthread+0x10d/0x150 <4> [87.472102] ? __pfx_kthread+0x10/0x10 <4> [87.472106] ret_from_fork+0x3d4/0x480 <4> [87.472108] ? __pfx_kthread+0x10/0x10 <4> [87.472111] ret_from_fork_asm+0x1a/0x30 <4> [87.472119] </TASK> <4> [87.472120] irq event stamp: 1270583 <4> [87.472121] hardirqs last enabled at (1270589): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.472124] hardirqs last disabled at (1270594): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.472126] softirqs last enabled at (1269956): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.472128] softirqs last disabled at (1269949): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.472130] ---[ end trace 0000000000000000 ]--- <5> [87.472713] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4414, lrc_seqno=4414, guc_id=0, flags=0x73 in no process [-1] <7> [87.472716] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.472774] ------------[ cut here ]------------ <4> [87.472775] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.472776] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#0: kworker/u64:0/12 <4> [87.472847] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.472914] efi_pstore nfnetlink autofs4 <4> [87.472922] CPU: 0 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.472925] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.472926] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.472927] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.472932] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.473001] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.473003] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [87.473005] RAX: ffffffffa120354b RBX: ffff888174aacb40 RCX: 0000000000000000 <4> [87.473006] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.473008] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.473009] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.473010] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.473011] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [87.473013] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.473014] CR2: 00007724b3cbd4b0 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [87.473015] PKRU: 55555554 <4> [87.473016] Call Trace: <4> [87.473018] <TASK> <4> [87.473021] ? lock_acquire+0xc4/0x2f0 <4> [87.473026] ? lock_release+0xd0/0x2b0 <4> [87.473031] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.473036] process_one_work+0x239/0x760 <4> [87.473042] worker_thread+0x200/0x3f0 <4> [87.473045] ? __pfx_worker_thread+0x10/0x10 <4> [87.473047] kthread+0x10d/0x150 <4> [87.473050] ? __pfx_kthread+0x10/0x10 <4> [87.473054] ret_from_fork+0x3d4/0x480 <4> [87.473055] ? __pfx_kthread+0x10/0x10 <4> [87.473059] ret_from_fork_asm+0x1a/0x30 <4> [87.473066] </TASK> <4> [87.473067] irq event stamp: 1273211 <4> [87.473068] hardirqs last enabled at (1273217): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.473071] hardirqs last disabled at (1273222): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.473073] softirqs last enabled at (1269956): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.473075] softirqs last disabled at (1269949): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.473078] ---[ end trace 0000000000000000 ]--- <6> [87.473079] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [87.473149] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [87.473155] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [87.473170] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [87.473273] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [87.473378] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [87.473583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [87.473672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [87.473767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [87.473856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [87.473947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [87.474032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [87.474116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [87.474202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [87.474284] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [87.474379] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [87.474497] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [87.475507] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [87.485915] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [87.486163] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [87.487188] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [87.487267] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [87.487342] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [87.487420] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [87.487496] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [87.487571] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [87.487647] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [87.487726] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [87.487803] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [87.487879] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [87.488006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [87.488080] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [87.488154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [87.488227] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [87.488299] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [87.488372] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [87.488444] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [87.488517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [87.488591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [87.488675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [87.488758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [87.488838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [87.488922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [87.489000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [87.489077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [87.489154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [87.489230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [87.489309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [87.489388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [87.489466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [87.489545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [87.489624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [87.489708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [87.489792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [87.489876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [87.489964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [87.490043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [87.490121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [87.490199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [87.490275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [87.490354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [87.490433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [87.490509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [87.490585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [87.490666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [87.490743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [87.490824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [87.490903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [87.490997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [87.491074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [87.491151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [87.491230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [87.491308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [87.491386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [87.491465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [87.491546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [87.491625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [87.491702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [87.491782] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [87.491894] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [87.491898] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4414, lrc_seqno=4414, guc_id=0, flags=0x73 in no process [-1] <7> [87.491900] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.492823] ------------[ cut here ]------------ <4> [87.492824] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.492826] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#4: kworker/u64:1/120 <4> [87.492899] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.492968] efi_pstore nfnetlink autofs4 <4> [87.492973] CPU: 4 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.492976] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.492977] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.492979] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.492984] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.493054] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.493056] RSP: 0018:ffffc9000055bc98 EFLAGS: 00010246 <4> [87.493058] RAX: ffffffffa120354b RBX: ffff888174aacb40 RCX: 0000000000000000 <4> [87.493060] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.493061] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.493062] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.493063] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.493065] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [87.493066] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.493068] CR2: 000071186c9e62f4 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [87.493069] PKRU: 55555554 <4> [87.493070] Call Trace: <4> [87.493072] <TASK> <4> [87.493076] ? lock_acquire+0xc4/0x2f0 <4> [87.493080] ? lock_release+0xd0/0x2b0 <4> [87.493085] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.493091] process_one_work+0x239/0x760 <4> [87.493097] worker_thread+0x200/0x3f0 <4> [87.493100] ? __pfx_worker_thread+0x10/0x10 <4> [87.493102] kthread+0x10d/0x150 <4> [87.493105] ? __pfx_kthread+0x10/0x10 <4> [87.493108] ret_from_fork+0x3d4/0x480 <4> [87.493110] ? __pfx_kthread+0x10/0x10 <4> [87.493114] ret_from_fork_asm+0x1a/0x30 <4> [87.493121] </TASK> <4> [87.493122] irq event stamp: 410359 <4> [87.493123] hardirqs last enabled at (410365): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.493126] hardirqs last disabled at (410370): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.493128] softirqs last enabled at (409250): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.493131] softirqs last disabled at (409243): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.493133] ---[ end trace 0000000000000000 ]--- <6> [87.493135] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [87.493205] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [87.493211] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [87.493225] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [87.493329] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [87.493618] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [87.493823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [87.493916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [87.494009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [87.494098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [87.494186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [87.494274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [87.494362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [87.494451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [87.494535] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [87.494629] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [87.494746] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [87.495755] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [87.505911] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [87.506158] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [87.507145] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [87.507225] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [87.507301] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [87.507377] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [87.507456] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [87.507534] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [87.507609] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [87.507684] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [87.507758] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [87.507832] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [87.507912] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [87.507988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [87.508061] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [87.508134] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [87.508209] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [87.508283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [87.508357] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [87.508430] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [87.508504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [87.508585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [87.508666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [87.508745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [87.508828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [87.508916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [87.508997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [87.509075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [87.509153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [87.509234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [87.509319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [87.509401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [87.509483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [87.509562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [87.509646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [87.509730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [87.509819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [87.509907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [87.509920] xe 0000:03:00.0: [drm:intel_power_well_enable [xe]] enabling AUX_TC2 <7> [87.509990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [87.510070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [87.510148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [87.510226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [87.510306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [87.510386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [87.510468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [87.510549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [87.510632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [87.510710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [87.510788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [87.510865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [87.510975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [87.511058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [87.511142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [87.511229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [87.511314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [87.511395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [87.511476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [87.511560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [87.511640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [87.511718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [87.511798] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [87.512759] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [87.512763] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4414, lrc_seqno=4414, guc_id=0, flags=0x73 in no process [-1] <7> [87.512765] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.512825] ------------[ cut here ]------------ <4> [87.512826] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.512828] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#0: kworker/u64:0/12 <4> [87.512900] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.512970] efi_pstore nfnetlink autofs4 <4> [87.512975] CPU: 0 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.512978] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.512979] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.512980] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.512986] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.513056] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.513057] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [87.513060] RAX: ffffffffa120354b RBX: ffff888174aacb40 RCX: 0000000000000000 <4> [87.513061] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.513063] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.513064] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.513065] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.513066] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [87.513068] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.513069] CR2: 00007724b3cbd4b0 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [87.513071] PKRU: 55555554 <4> [87.513072] Call Trace: <4> [87.513073] <TASK> <4> [87.513077] ? lock_acquire+0xc4/0x2f0 <4> [87.513082] ? lock_release+0xd0/0x2b0 <4> [87.513087] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.513093] process_one_work+0x239/0x760 <4> [87.513099] worker_thread+0x200/0x3f0 <4> [87.513101] ? __pfx_worker_thread+0x10/0x10 <4> [87.513104] kthread+0x10d/0x150 <4> [87.513107] ? __pfx_kthread+0x10/0x10 <4> [87.513110] ret_from_fork+0x3d4/0x480 <4> [87.513112] ? __pfx_kthread+0x10/0x10 <4> [87.513116] ret_from_fork_asm+0x1a/0x30 <4> [87.513123] </TASK> <4> [87.513124] irq event stamp: 1276843 <4> [87.513125] hardirqs last enabled at (1276849): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.513128] hardirqs last disabled at (1276854): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.513130] softirqs last enabled at (1276110): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.513132] softirqs last disabled at (1276105): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.513135] ---[ end trace 0000000000000000 ]--- <7> [87.513148] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [87.513250] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [87.513953] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4469, lrc_seqno=4469, guc_id=0, flags=0x73 in no process [-1] <7> [87.513959] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.514066] ------------[ cut here ]------------ <4> [87.514067] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.514069] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#12: kworker/u64:5/204 <4> [87.514186] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.514277] efi_pstore nfnetlink autofs4 <4> [87.514283] CPU: 12 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.514286] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.514288] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.514290] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.514298] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.514411] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.514414] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [87.514417] RAX: ffffffffa120354b RBX: ffff888174b3b640 RCX: 0000000000000000 <4> [87.514419] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.514420] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.514422] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.514424] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.514426] FS: 0000000000000000(0000) GS:ffff8888db297000(0000) knlGS:0000000000000000 <4> [87.514428] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.514430] CR2: 000075ce18fb1000 CR3: 000000012bf77001 CR4: 0000000000f72ef0 <4> [87.514432] PKRU: 55555554 <4> [87.514434] Call Trace: <4> [87.514435] <TASK> <4> [87.514442] ? lock_acquire+0xc4/0x2f0 <4> [87.514449] ? lock_release+0xd0/0x2b0 <4> [87.514457] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.514467] process_one_work+0x239/0x760 <4> [87.514477] worker_thread+0x200/0x3f0 <4> [87.514481] ? __pfx_worker_thread+0x10/0x10 <4> [87.514485] kthread+0x10d/0x150 <4> [87.514489] ? __pfx_kthread+0x10/0x10 <4> [87.514494] ret_from_fork+0x3d4/0x480 <4> [87.514497] ? __pfx_kthread+0x10/0x10 <4> [87.514502] ret_from_fork_asm+0x1a/0x30 <4> [87.514514] </TASK> <4> [87.514516] irq event stamp: 429897 <4> [87.514518] hardirqs last enabled at (429903): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.514522] hardirqs last disabled at (429908): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.514525] softirqs last enabled at (429026): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.514528] softirqs last disabled at (429001): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.514532] ---[ end trace 0000000000000000 ]--- <6> [87.514535] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [87.514648] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [87.514657] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [87.514763] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [87.515015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [87.515155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [87.515293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [87.515427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [87.515559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [87.515691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [87.515824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [87.515966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [87.516098] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [87.516240] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [87.516407] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [87.517782] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [87.527910] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [87.528222] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [87.529394] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [87.529515] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [87.529635] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [87.529767] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [87.529847] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [87.529936] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [87.530014] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [87.530091] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [87.530168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [87.530249] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [87.530327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [87.530403] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [87.530478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [87.530552] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [87.530626] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [87.530699] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [87.530772] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [87.530847] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [87.530925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [87.531007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [87.531090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [87.531171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [87.531251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [87.531328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [87.531405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [87.531481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [87.531557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [87.531637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [87.531720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [87.531801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [87.531881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [87.531973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [87.532058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [87.532142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [87.532226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [87.532307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [87.532385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [87.532462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [87.532538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [87.532613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [87.532691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [87.532768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [87.532845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [87.532924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [87.533006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [87.533082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [87.533158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [87.533234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [87.533310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [87.533385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [87.533459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [87.533537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [87.533614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [87.533691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [87.533769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [87.533850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [87.533934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [87.534011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [87.534090] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [87.534202] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [87.534207] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4469, lrc_seqno=4469, guc_id=0, flags=0x73 in no process [-1] <7> [87.534209] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.534269] ------------[ cut here ]------------ <4> [87.534270] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.534271] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#11: kworker/u64:5/204 <4> [87.534342] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.534407] efi_pstore nfnetlink autofs4 <4> [87.534412] CPU: 11 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.534415] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.534416] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.534417] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.534422] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.534492] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.534494] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [87.534496] RAX: ffffffffa120354b RBX: ffff888174b3b640 RCX: 0000000000000000 <4> [87.534497] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.534499] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.534500] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.534501] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.534502] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [87.534504] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.534505] CR2: 000075ce18fa6000 CR3: 000000012322c002 CR4: 0000000000f72ef0 <4> [87.534507] PKRU: 55555554 <4> [87.534508] Call Trace: <4> [87.534509] <TASK> <4> [87.534513] ? lock_acquire+0xc4/0x2f0 <4> [87.534518] ? lock_release+0xd0/0x2b0 <4> [87.534523] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.534529] process_one_work+0x239/0x760 <4> [87.534535] worker_thread+0x200/0x3f0 <4> [87.534538] ? __pfx_worker_thread+0x10/0x10 <4> [87.534540] kthread+0x10d/0x150 <4> [87.534543] ? __pfx_kthread+0x10/0x10 <4> [87.534547] ret_from_fork+0x3d4/0x480 <4> [87.534549] ? __pfx_kthread+0x10/0x10 <4> [87.534552] ret_from_fork_asm+0x1a/0x30 <4> [87.534559] </TASK> <4> [87.534561] irq event stamp: 433005 <4> [87.534562] hardirqs last enabled at (433011): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.534565] hardirqs last disabled at (433016): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.534567] softirqs last enabled at (431964): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.534569] softirqs last disabled at (431959): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.534572] ---[ end trace 0000000000000000 ]--- <6> [87.534574] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [87.534643] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [87.534649] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [87.535065] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [87.535269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [87.535358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [87.535450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [87.535536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [87.535622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [87.535707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [87.535792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [87.535879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [87.535973] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [87.536068] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [87.536185] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [87.537193] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [87.547901] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [87.548146] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [87.549146] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [87.549225] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [87.549302] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [87.549380] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [87.549457] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [87.549533] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [87.549610] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [87.549687] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [87.549764] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [87.549840] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [87.549920] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [87.549995] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [87.550069] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [87.550142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [87.550215] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [87.550288] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [87.550361] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [87.550434] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [87.550506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [87.550589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [87.550671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [87.550749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [87.550829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [87.550919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [87.550995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [87.551071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [87.551149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [87.551231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [87.551314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [87.551393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [87.551473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [87.551551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [87.551635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [87.551719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [87.551802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [87.551882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [87.551973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [87.552053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [87.552135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [87.552215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [87.552297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [87.552376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [87.552454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [87.552531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [87.552612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [87.552689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [87.552766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [87.552842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [87.552925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [87.553002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [87.553083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [87.553164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [87.553244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [87.553322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [87.553398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [87.553475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [87.553552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [87.553627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [87.553706] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [87.553815] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [87.553819] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4469, lrc_seqno=4469, guc_id=0, flags=0x73 in no process [-1] <7> [87.553822] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.553881] ------------[ cut here ]------------ <4> [87.553882] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.553884] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#11: kworker/u64:5/204 <4> [87.553969] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.554034] efi_pstore nfnetlink autofs4 <4> [87.554038] CPU: 11 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.554041] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.554043] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.554044] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.554049] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.554119] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.554121] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [87.554123] RAX: ffffffffa120354b RBX: ffff888174b3b640 RCX: 0000000000000000 <4> [87.554125] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.554126] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.554127] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.554129] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.554130] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [87.554132] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.554133] CR2: 000075ce18fa6000 CR3: 000000012322c002 CR4: 0000000000f72ef0 <4> [87.554135] PKRU: 55555554 <4> [87.554136] Call Trace: <4> [87.554137] <TASK> <4> [87.554141] ? lock_acquire+0xc4/0x2f0 <4> [87.554145] ? lock_release+0xd0/0x2b0 <4> [87.554150] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.554156] process_one_work+0x239/0x760 <4> [87.554162] worker_thread+0x200/0x3f0 <4> [87.554164] ? __pfx_worker_thread+0x10/0x10 <4> [87.554167] kthread+0x10d/0x150 <4> [87.554169] ? __pfx_kthread+0x10/0x10 <4> [87.554173] ret_from_fork+0x3d4/0x480 <4> [87.554175] ? __pfx_kthread+0x10/0x10 <4> [87.554178] ret_from_fork_asm+0x1a/0x30 <4> [87.554186] </TASK> <4> [87.554187] irq event stamp: 436213 <4> [87.554188] hardirqs last enabled at (436219): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.554191] hardirqs last disabled at (436224): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.554193] softirqs last enabled at (435218): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.554195] softirqs last disabled at (435211): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.554197] ---[ end trace 0000000000000000 ]--- <7> [87.555910] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [87.556017] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [87.556133] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4524, lrc_seqno=4524, guc_id=0, flags=0x73 in no process [-1] <7> [87.556137] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.556199] ------------[ cut here ]------------ <4> [87.556200] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.556202] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#0: kworker/u64:0/12 <4> [87.556276] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.556341] efi_pstore nfnetlink autofs4 <4> [87.556345] CPU: 0 UID: 0 PID: 12 Comm: kworker/u64:0 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.556348] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.556349] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.556351] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.556356] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.556427] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.556429] RSP: 0018:ffffc900000b7c98 EFLAGS: 00010246 <4> [87.556431] RAX: ffffffffa120354b RBX: ffff888174c06640 RCX: 0000000000000000 <4> [87.556432] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.556434] RBP: ffffc900000b7db0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.556435] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.556436] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.556437] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [87.556439] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.556440] CR2: 00007724b3cbd4b0 CR3: 0000000139464006 CR4: 0000000000f72ef0 <4> [87.556442] PKRU: 55555554 <4> [87.556443] Call Trace: <4> [87.556444] <TASK> <4> [87.556448] ? lock_acquire+0xc4/0x2f0 <4> [87.556453] ? lock_release+0xd0/0x2b0 <4> [87.556458] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.556464] process_one_work+0x239/0x760 <4> [87.556470] worker_thread+0x200/0x3f0 <4> [87.556472] ? __pfx_worker_thread+0x10/0x10 <4> [87.556475] kthread+0x10d/0x150 <4> [87.556478] ? __pfx_kthread+0x10/0x10 <4> [87.556481] ret_from_fork+0x3d4/0x480 <4> [87.556483] ? __pfx_kthread+0x10/0x10 <4> [87.556487] ret_from_fork_asm+0x1a/0x30 <4> [87.556494] </TASK> <4> [87.556495] irq event stamp: 1282627 <4> [87.556496] hardirqs last enabled at (1282633): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.556499] hardirqs last disabled at (1282638): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.556501] softirqs last enabled at (1281422): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.556504] softirqs last disabled at (1281415): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.556506] ---[ end trace 0000000000000000 ]--- <6> [87.556508] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [87.556579] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [87.556585] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [87.556691] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [87.556908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [87.556998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [87.557091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [87.557180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [87.557268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [87.557353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [87.557440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [87.557529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [87.557613] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [87.557707] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [87.557825] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [87.558847] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [87.568896] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [87.569146] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [87.570168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [87.570248] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [87.570325] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [87.570403] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [87.570479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [87.570556] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [87.570631] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [87.570707] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [87.570785] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [87.570860] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [87.570950] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [87.571025] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [87.571099] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [87.571171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [87.571245] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [87.571319] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [87.571393] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [87.571466] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [87.571540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [87.571620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [87.571702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [87.571779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [87.571860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [87.571948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [87.572028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [87.572108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [87.572186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [87.572267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [87.572348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [87.572427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [87.572507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [87.572586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [87.572671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [87.572758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [87.572845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [87.572936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [87.573017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [87.573095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [87.573173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [87.573249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [87.573329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [87.573407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [87.573485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [87.573561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [87.573641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [87.573716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [87.573794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [87.573869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [87.573958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [87.574038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [87.574116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [87.574197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [87.574274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [87.574354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [87.574430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [87.574507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [87.574583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [87.574661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [87.574743] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [87.574853] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [87.574857] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4524, lrc_seqno=4524, guc_id=0, flags=0x73 in no process [-1] <7> [87.574860] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.575818] ------------[ cut here ]------------ <4> [87.575819] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.575821] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#11: kworker/u64:5/204 <4> [87.575924] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.575991] efi_pstore nfnetlink autofs4 <4> [87.575996] CPU: 11 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.575999] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.576000] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.576001] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.576007] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.576078] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.576079] RSP: 0018:ffffc90001627c98 EFLAGS: 00010246 <4> [87.576082] RAX: ffffffffa120354b RBX: ffff888174c06640 RCX: 0000000000000000 <4> [87.576083] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.576084] RBP: ffffc90001627db0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.576085] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.576087] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.576088] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000 <4> [87.576090] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.576091] CR2: 000075ce18fa6000 CR3: 000000012322c002 CR4: 0000000000f72ef0 <4> [87.576093] PKRU: 55555554 <4> [87.576094] Call Trace: <4> [87.576095] <TASK> <4> [87.576099] ? lock_acquire+0xc4/0x2f0 <4> [87.576103] ? lock_release+0xd0/0x2b0 <4> [87.576109] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.576114] process_one_work+0x239/0x760 <4> [87.576120] worker_thread+0x200/0x3f0 <4> [87.576123] ? __pfx_worker_thread+0x10/0x10 <4> [87.576125] kthread+0x10d/0x150 <4> [87.576128] ? __pfx_kthread+0x10/0x10 <4> [87.576132] ret_from_fork+0x3d4/0x480 <4> [87.576134] ? __pfx_kthread+0x10/0x10 <4> [87.576137] ret_from_fork_asm+0x1a/0x30 <4> [87.576144] </TASK> <4> [87.576146] irq event stamp: 440933 <4> [87.576147] hardirqs last enabled at (440939): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.576150] hardirqs last disabled at (440944): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.576152] softirqs last enabled at (440016): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.576154] softirqs last disabled at (440011): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.576156] ---[ end trace 0000000000000000 ]--- <6> [87.576159] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [87.576228] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [87.576234] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [87.576249] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [87.576353] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [87.576645] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [87.576852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [87.576952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [87.577048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [87.577137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [87.577223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [87.577309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [87.577396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [87.577484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [87.577567] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [87.577662] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [87.577779] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [87.578798] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [87.588892] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [87.589141] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [87.590149] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [87.590229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [87.590306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [87.590383] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [87.590459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [87.590534] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [87.590610] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [87.590684] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [87.590759] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [87.590833] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [87.590916] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [87.590992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [87.591067] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [87.591141] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [87.591216] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [87.591291] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [87.591363] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [87.591436] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [87.591508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [87.591589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [87.591669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [87.591750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [87.591833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [87.591920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [87.591998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [87.592075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [87.592150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [87.592230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [87.592309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [87.592388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [87.592465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [87.592544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [87.592627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [87.592711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [87.592798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [87.592887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [87.592969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [87.593048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [87.593126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [87.593202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [87.593280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [87.593358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [87.593435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [87.593511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [87.593591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [87.593666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [87.593744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [87.593820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [87.593903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [87.593982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [87.594060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [87.594140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [87.594218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [87.594295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [87.594373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [87.594456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [87.594536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [87.594613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [87.594694] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [87.594805] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [87.594809] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4524, lrc_seqno=4524, guc_id=0, flags=0x73 in no process [-1] <7> [87.594811] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.594869] ------------[ cut here ]------------ <4> [87.594870] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.594872] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#4: kworker/u64:1/120 <4> [87.594958] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.595023] efi_pstore nfnetlink autofs4 <4> [87.595028] CPU: 4 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.595031] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.595032] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.595034] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.595039] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.595109] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.595110] RSP: 0018:ffffc9000055bc98 EFLAGS: 00010246 <4> [87.595113] RAX: ffffffffa120354b RBX: ffff888174c06640 RCX: 0000000000000000 <4> [87.595114] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.595115] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.595117] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.595118] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.595119] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [87.595121] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.595122] CR2: 000071186c9e62f4 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [87.595124] PKRU: 55555554 <4> [87.595125] Call Trace: <4> [87.595126] <TASK> <4> [87.595130] ? lock_acquire+0xc4/0x2f0 <4> [87.595135] ? lock_release+0xd0/0x2b0 <4> [87.595140] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.595146] process_one_work+0x239/0x760 <4> [87.595152] worker_thread+0x200/0x3f0 <4> [87.595155] ? __pfx_worker_thread+0x10/0x10 <4> [87.595157] kthread+0x10d/0x150 <4> [87.595160] ? __pfx_kthread+0x10/0x10 <4> [87.595164] ret_from_fork+0x3d4/0x480 <4> [87.595166] ? __pfx_kthread+0x10/0x10 <4> [87.595169] ret_from_fork_asm+0x1a/0x30 <4> [87.595176] </TASK> <4> [87.595178] irq event stamp: 414543 <4> [87.595179] hardirqs last enabled at (414549): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.595182] hardirqs last disabled at (414554): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.595184] softirqs last enabled at (413800): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.595186] softirqs last disabled at (413783): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.595189] ---[ end trace 0000000000000000 ]--- <5> [87.596648] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4579, lrc_seqno=4579, guc_id=0, flags=0x73 in no process [-1] <7> [87.596651] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.596712] ------------[ cut here ]------------ <4> [87.596713] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.596715] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#4: kworker/u64:1/120 <4> [87.596785] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.596848] efi_pstore nfnetlink autofs4 <4> [87.596852] CPU: 4 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.596855] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.596856] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.596857] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.596862] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.596940] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.596942] RSP: 0018:ffffc9000055bc98 EFLAGS: 00010246 <4> [87.596944] RAX: ffffffffa120354b RBX: ffff888174c91b40 RCX: 0000000000000000 <4> [87.596946] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.596947] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.596948] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.596949] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.596951] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [87.596952] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.596954] CR2: 000071186c9e62f4 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [87.596955] PKRU: 55555554 <4> [87.596957] Call Trace: <4> [87.596958] <TASK> <4> [87.596962] ? lock_acquire+0xc4/0x2f0 <4> [87.596966] ? lock_release+0xd0/0x2b0 <4> [87.596971] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.596977] process_one_work+0x239/0x760 <4> [87.596983] worker_thread+0x200/0x3f0 <4> [87.596986] ? __pfx_worker_thread+0x10/0x10 <4> [87.596988] kthread+0x10d/0x150 <4> [87.596991] ? __pfx_kthread+0x10/0x10 <4> [87.596994] ret_from_fork+0x3d4/0x480 <4> [87.596996] ? __pfx_kthread+0x10/0x10 <4> [87.597000] ret_from_fork_asm+0x1a/0x30 <4> [87.597007] </TASK> <4> [87.597009] irq event stamp: 417219 <4> [87.597010] hardirqs last enabled at (417225): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.597012] hardirqs last disabled at (417230): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.597015] softirqs last enabled at (413800): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.597017] softirqs last disabled at (413783): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.597019] ---[ end trace 0000000000000000 ]--- <7> [87.597033] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [87.597137] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [87.597237] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [87.597310] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [87.597315] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [87.597362] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [87.597565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [87.597654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [87.597747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [87.597835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [87.597931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [87.598020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [87.598110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [87.598198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [87.598280] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [87.598376] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [87.598493] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [87.599501] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [87.609887] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [87.610137] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [87.611118] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [87.611198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [87.611275] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [87.611353] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [87.611430] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [87.611507] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [87.611585] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [87.611661] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [87.611736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [87.611810] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [87.611890] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [87.611964] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [87.612038] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [87.612111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [87.612183] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [87.612257] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [87.612330] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [87.612403] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [87.612475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [87.612554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [87.612635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [87.612715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [87.612796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [87.612873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [87.612964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [87.613040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [87.613116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [87.613196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [87.613275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [87.613352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [87.613430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [87.613508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [87.613591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [87.613678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [87.613763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [87.613844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [87.613934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [87.613934] xe 0000:03:00.0: [drm:intel_power_well_disable [xe]] disabling AUX_TC2 <7> [87.614012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [87.614089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [87.614165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [87.614248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [87.614330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [87.614408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [87.614486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [87.614567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [87.614644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [87.614721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [87.614796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [87.614872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [87.614962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [87.615038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [87.615119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [87.615199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [87.615278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [87.615356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [87.615434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [87.615509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [87.615585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [87.615664] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [87.615774] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [87.615778] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4579, lrc_seqno=4579, guc_id=0, flags=0x73 in no process [-1] <7> [87.615780] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [87.615838] ------------[ cut here ]------------ <4> [87.615839] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [87.615840] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1627 at guc_exec_queue_timedout_job+0x128b/0x2210 [xe], CPU#4: kworker/u64:1/120 <4> [87.615920] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse <4> [87.615984] efi_pstore nfnetlink autofs4 <4> [87.615988] CPU: 4 UID: 0 PID: 120 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-lgci-xe-xe-pw-163428v3-debug+ #1 PREEMPT(lazy) <4> [87.615991] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [87.615992] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [87.615993] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [87.615998] RIP: 0010:guc_exec_queue_timedout_job+0x1294/0x2210 [xe] <4> [87.616069] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14 <4> [87.616070] RSP: 0018:ffffc9000055bc98 EFLAGS: 00010246 <4> [87.616073] RAX: ffffffffa120354b RBX: ffff888174c91b40 RCX: 0000000000000000 <4> [87.616074] RDX: ffff88810422b810 RSI: ffffffffa120354b RDI: ffffffffa1003ee0 <4> [87.616075] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [87.616076] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [87.616078] R13: ffff888123813200 R14: ffff88810422b810 R15: 00000000ffffffc2 <4> [87.616079] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [87.616080] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [87.616082] CR2: 000071186c9e62f4 CR3: 000000000344c001 CR4: 0000000000f72ef0 <4> [87.616083] PKRU: 55555554 <4> [87.616084] Call Trace: <4> [87.616085] <TASK> <4> [87.616089] ? lock_acquire+0xc4/0x2f0 <4> [87.616094] ? lock_release+0xd0/0x2b0 <4> [87.616099] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [87.616104] process_one_work+0x239/0x760 <4> [87.616110] worker_thread+0x200/0x3f0 <4> [87.616113] ? __pfx_worker_thread+0x10/0x10 <4> [87.616115] kthread+0x10d/0x150 <4> [87.616118] ? __pfx_kthread+0x10/0x10 <4> [87.616122] ret_from_fork+0x3d4/0x480 <4> [87.616124] ? __pfx_kthread+0x10/0x10 <4> [87.616127] ret_from_fork_asm+0x1a/0x30 <4> [87.616135] </TASK> <4> [87.616136] irq event stamp: 420325 <4> [87.616137] hardirqs last enabled at (420331): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0 <4> [87.616140] hardirqs last disabled at (420336): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0 <4> [87.616142] softirqs last enabled at (419330): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.616144] softirqs last disabled at (419325): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [87.616147] ---[ end trace 0000000000000000 ]--- <6> [87.617069] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [87.617140] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [87.617147] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [87.617161] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [87.617263] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [87.617368] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [87.617572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [87.617664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [87.617759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [87.617847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [87.617948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [87.618035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [87.618125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [87.618216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100

<4> [86.186039] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.186238] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.207165] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.207325] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.226647] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.226801] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.228679] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.228908] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.251124] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.251291] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.272062] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.272217] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.274176] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.274337] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.293473] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.293621] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.314320] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.314470] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.315461] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.315622] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.335315] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.335465] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.355257] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.355407] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.357008] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.357154] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.376309] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.376458] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.396253] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.396404] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.397381] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.397551] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.417417] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.417567] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.437246] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.437395] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.439063] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.439217] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.458317] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.458465] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.478357] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.478521] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.479942] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.480090] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.499200] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.499349] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.519243] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.519392] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.521049] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.521207] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.541373] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.541522] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.560242] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.560393] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.562064] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.562221] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.581426] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.581574] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.601211] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.601361] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.603074] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.603225] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.622180] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.622328] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.642420] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.642572] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.643607] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.643943] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.663251] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.663399] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.682254] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.682401] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.683467] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.683709] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.703197] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.703346] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.722835] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.722981] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.725022] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.725257] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.746269] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.746451] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.768452] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.768607] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.769848] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.770085] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.791013] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.791166] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.811448] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.811596] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.813455] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.813600] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.832091] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.832238] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.852147] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.852298] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.853901] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.854046] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.873129] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.873279] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.892776] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.892922] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.895186] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.895332] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.914097] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.914246] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.934514] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.934665] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.935565] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.935734] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.955080] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.955227] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.974696] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.974845] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.976814] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp

<4> [86.976838] hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [86.976962] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [86.995977] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [86.996130] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.015442] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.015592] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.017174] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.017320] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.036129] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.036276] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.056857] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.057006] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.058746] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.058893] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.078552] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.078698] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.099067] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.099218] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.100818] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.100966] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.120071] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.120221] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.140785] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.140932] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.141922] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.142110] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.161062] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.161212] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.181941] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.182101] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.183129] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.183275] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.202008] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.202157] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.222953] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.223108] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.224439] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.224594] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.244401] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.244554] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.265223] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.265375] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.266623] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.266885] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.286259] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.286409] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.306210] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.306356] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.308394] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.308657] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.329409] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.329558] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.350088] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.350237] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.352078] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.352226] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.371878] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.372034] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.390959] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.391107] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.392695] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.392843] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.412301] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.412452] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.432976] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.433126] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.434135] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.434381] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.452590] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.452725] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.471896] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.472051] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.472847] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.473001] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.492899] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.493054] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.512900] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.513056] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.514186] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.514411] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.534342] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.534492] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.553969] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.554119] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.556276] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.556427] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.575924] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.576078] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.594958] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.595109] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.596785] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.596940] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

<4> [87.615920] Modules linked in: pmt_crashlog snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_gsc_proxy mei_lb mei_gsc mtd_intel_dg xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart eeepc_wmi coretemp spi_nor mei_hdcp mei_pxp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel usbhid kvm snd_hda_intel irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core r8169 snd_hwdep intel_cstate snd_pcm video snd_timer nls_iso8859_1 realtek i2c_i801 idma64 spi_intel_pci i2c_mux snd mei_me spi_intel soundcore i2c_smbus mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry intel_vsec acpi_pad wmi acpi_tad pinctrl_alderlake dm_multipath msr nvme_fabrics fuse

<4> [87.616069] Code: 8b 7f 08 4c 8b 77 50 4d 85 f6 75 03 4c 8b 37 89 4d 90 e8 af d8 5e e1 48 89 c6 48 8d 3d 35 95 39 00 8b 4d 90 45 89 e0 4c 89 f2 <67> 48 0f b9 3a 49 8b 45 60 e9 42 f4 ff ff 48 8b 45 80 8b 90 c8 14

Results for igt@xe_pat@pt-caching-random-offsets