igt@xe_pat@pt-caching on shard-bmg@xe-5041-f8ee23694aa6be213355905a78f79bb1b0861565 Test details

Detail	Value
Duration	unknown
Hostname	shard-bmg-7
Igt-Version	IGT-Version: 2.4-gd28bd0b9e (x86_64) (Linux: 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ x86_64)
Out	Using IGT_SRANDOM=1778521272 for randomisation Opened device: /dev/dri/card0 Test requirement not met in function __igt_unique____real_main2210, file ../tests/intel/xe_pat.c:2298: Test requirement: intel_graphics_ver(dev_id) == IP_VER(35, 10) Last errno: 2, No such file or directory Starting subtest: pt-caching va_bits: 48, num_objs: 16384, spread over pt levels: [0]: 16384 [1]: 512 [2]: 16 Subtest pt-caching: SUCCESS (9.666s) This test caused an abort condition: Kernel badly tainted (0x244, 0x200) (check dmesg for details): TAINT_WARN: WARN_ON has happened.
Err	Starting subtest: pt-caching Subtest pt-caching: SUCCESS (9.666s)
Dmesg Scroll to first warning	<6> [115.427776] Console: switching to colour dummy device 80x25 <6> [115.428125] [IGT] xe_pat: executing <6> [115.458425] [IGT] xe_pat: starting subtest pt-caching <6> [117.168977] xe 0000:03:00.0: [drm] Tile0: GT0: ASID: 0 Faulted Address: 0x000000000060b000 FaultType: 0 AccessType: 0 FaultLevel: 0 EngineClass: 3 bcs EngineInstance: 8 <6> [117.168992] xe 0000:03:00.0: [drm] Tile0: GT0: Fault response: Unsuccessful -EINVAL <6> [117.169036] xe 0000:03:00.0: [drm] Tile0: GT0: Engine memory CAT error [18]: class=bcs, logical_mask: 0x2, guc_id=0 <6> [117.169892] xe 0000:03:00.0: [drm] Tile0: GT0: Engine reset: engine_class=bcs, logical_mask: 0x2, guc_id=0, state=0x249 <5> [117.170140] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=42600, lrc_seqno=42600, guc_id=0, flags=0x73 in no process [-1] <7> [117.170231] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.170371] ------------[ cut here ]------------ <4> [117.170373] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.170375] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#9: kworker/u64:5/202 <4> [117.170473] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.170552] CPU: 9 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.170556] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER <4> [117.170557] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.170559] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.170566] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.170650] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.170652] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.170654] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.170656] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.170657] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.170658] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.170659] R13: ffff888101c23f90 R14: ffff888131e68000 R15: 00000000fffffffb <4> [117.170661] FS: 0000000000000000(0000) GS:ffff8888db103000(0000) knlGS:0000000000000000 <4> [117.170662] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.170663] CR2: 0000000627e231d8 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [117.170665] PKRU: 55555554 <4> [117.170666] Call Trace: <4> [117.170667] <TASK> <4> [117.170672] ? lock_acquire+0x60/0x300 <4> [117.170678] ? __pfx_autoremove_wake_function+0x10/0x10 <4> [117.170684] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.170690] process_one_work+0x239/0x740 <4> [117.170698] worker_thread+0x200/0x3f0 <4> [117.170701] ? __pfx_worker_thread+0x10/0x10 <4> [117.170704] kthread+0x10d/0x150 <4> [117.170706] ? __pfx_kthread+0x10/0x10 <4> [117.170709] ret_from_fork+0x3bd/0x470 <4> [117.170712] ? __pfx_kthread+0x10/0x10 <4> [117.170715] ret_from_fork_asm+0x1a/0x30 <4> [117.170723] </TASK> <4> [117.170724] irq event stamp: 1786089 <4> [117.170725] hardirqs last enabled at (1786095): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.170728] hardirqs last disabled at (1786100): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.170729] softirqs last enabled at (1781644): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.170733] softirqs last disabled at (1781639): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.170736] ---[ end trace 0000000000000000 ]--- <6> [117.170738] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.170820] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.170903] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.171023] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.171491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.171598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.171697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.171787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.171902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.171989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.172078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.172167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.172248] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.172349] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.172444] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.173579] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.184244] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.184548] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.186005] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.186105] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.186196] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.186286] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.186375] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.186461] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.186546] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.186630] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.186713] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.186793] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.186882] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.186964] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.187044] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.187125] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.187205] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.187286] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.187367] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.187448] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.187529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.187620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.187710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.187799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.187892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.187980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.188066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.188150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.188233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.188318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.188403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.188491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.188578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.188661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.188747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.188996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.189096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.189189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.189280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.189365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.189454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.189538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.189621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.189702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.189784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.189879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.189964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.190048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.190131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.190211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.190291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.190372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.190457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.190540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.190623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.190704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.190783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.190871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.190953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.191035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.191115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.191200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.191282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.191364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.191445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.191523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.191604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.191686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.191767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.191849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.191934] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.192500] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.192505] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=42600, lrc_seqno=42600, guc_id=0, flags=0x73 in no process [-1] <7> [117.192508] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.192583] ------------[ cut here ]------------ <4> [117.192585] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.192586] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#9: kworker/u64:5/202 <4> [117.192671] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.192740] CPU: 9 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.192743] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.192744] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.192746] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.192752] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.192980] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.192982] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.192985] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.192986] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.192988] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.192989] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.192990] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.192991] FS: 0000000000000000(0000) GS:ffff8888db103000(0000) knlGS:0000000000000000 <4> [117.192993] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.192994] CR2: 0000000627e231d8 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [117.192996] PKRU: 55555554 <4> [117.192997] Call Trace: <4> [117.192998] <TASK> <4> [117.193002] ? lock_acquire+0x60/0x300 <4> [117.193008] ? lock_release+0xd0/0x2b0 <4> [117.193013] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.193020] process_one_work+0x239/0x740 <4> [117.193028] worker_thread+0x200/0x3f0 <4> [117.193031] ? __pfx_worker_thread+0x10/0x10 <4> [117.193034] kthread+0x10d/0x150 <4> [117.193036] ? __pfx_kthread+0x10/0x10 <4> [117.193039] ret_from_fork+0x3bd/0x470 <4> [117.193042] ? __pfx_kthread+0x10/0x10 <4> [117.193044] ret_from_fork_asm+0x1a/0x30 <4> [117.193052] </TASK> <4> [117.193054] irq event stamp: 1789263 <4> [117.193055] hardirqs last enabled at (1789269): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.193057] hardirqs last disabled at (1789274): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.193059] softirqs last enabled at (1788258): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.193062] softirqs last disabled at (1788253): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.193065] ---[ end trace 0000000000000000 ]--- <6> [117.193067] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.193152] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.193160] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.193368] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.193583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.193681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.193779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.193883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.193972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.194060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.194149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.194239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.194324] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.194425] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.194520] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.195555] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.206189] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.206450] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.207532] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.207622] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.207705] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.207786] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.207880] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.207960] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.208038] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.208115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.208191] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.208268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.208343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.208420] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.208500] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.208577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.208653] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.208729] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.208806] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.208893] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.208970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.209058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.209143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.209229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.209310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.209391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.209471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.209549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.209625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.209702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.209778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.209887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.209967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.210045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.210124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.210202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.210286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.210371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.210454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.210555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.210637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.210719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.210801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.210890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.210967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.211046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.211126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.211205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.211283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.211360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.211437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.211515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.211595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.211671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.211749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.211826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.212167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.212253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.212335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.212413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.212490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.212571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.212649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.212727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.212805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.212892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.212971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.213048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.213125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.213199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.213279] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.213526] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.213530] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=42600, lrc_seqno=42600, guc_id=0, flags=0x73 in no process [-1] <7> [117.213533] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.213605] ------------[ cut here ]------------ <4> [117.213607] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.213608] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#9: kworker/u64:5/202 <4> [117.213809] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.213988] CPU: 9 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.213991] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.213994] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.213996] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.214002] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.214081] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.214083] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.214085] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.214086] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.214088] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.214089] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.214090] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.214092] FS: 0000000000000000(0000) GS:ffff8888db103000(0000) knlGS:0000000000000000 <4> [117.214093] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.214094] CR2: 0000000627e231d8 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [117.214096] PKRU: 55555554 <4> [117.214097] Call Trace: <4> [117.214098] <TASK> <4> [117.214102] ? lock_acquire+0x60/0x300 <4> [117.214108] ? lock_release+0xd0/0x2b0 <4> [117.214112] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.214119] process_one_work+0x239/0x740 <4> [117.214126] worker_thread+0x200/0x3f0 <4> [117.214129] ? __pfx_worker_thread+0x10/0x10 <4> [117.214132] kthread+0x10d/0x150 <4> [117.214134] ? __pfx_kthread+0x10/0x10 <4> [117.214137] ret_from_fork+0x3bd/0x470 <4> [117.214139] ? __pfx_kthread+0x10/0x10 <4> [117.214142] ret_from_fork_asm+0x1a/0x30 <4> [117.214150] </TASK> <4> [117.214151] irq event stamp: 1792415 <4> [117.214152] hardirqs last enabled at (1792421): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.214155] hardirqs last disabled at (1792426): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.214156] softirqs last enabled at (1791106): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.214159] softirqs last disabled at (1791097): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.214162] ---[ end trace 0000000000000000 ]--- <5> [117.215416] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=42655, lrc_seqno=42655, guc_id=0, flags=0x73 in no process [-1] <7> [117.215422] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.215528] ------------[ cut here ]------------ <4> [117.215530] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.215532] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:2/119 <4> [117.215707] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.215817] CPU: 8 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.215821] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.215823] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.215825] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.215844] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.215970] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.215973] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [117.215977] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.215979] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.215982] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.215984] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.215985] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.215987] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [117.215990] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.215992] CR2: 0000000627dd9000 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [117.215994] PKRU: 55555554 <4> [117.215996] Call Trace: <4> [117.215997] <TASK> <4> [117.216004] ? lock_acquire+0x60/0x300 <4> [117.216013] ? lock_release+0xd0/0x2b0 <4> [117.216022] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.216033] process_one_work+0x239/0x740 <7> [117.215963] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [117.216045] worker_thread+0x200/0x3f0 <4> [117.216049] ? __pfx_worker_thread+0x10/0x10 <4> [117.216053] kthread+0x10d/0x150 <4> [117.216056] ? __pfx_kthread+0x10/0x10 <4> [117.216061] ret_from_fork+0x3bd/0x470 <4> [117.216064] ? __pfx_kthread+0x10/0x10 <4> [117.216067] ret_from_fork_asm+0x1a/0x30 <4> [117.216078] </TASK> <4> [117.216080] irq event stamp: 1696411 <4> [117.216081] hardirqs last enabled at (1696417): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.216084] hardirqs last disabled at (1696422): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.216087] softirqs last enabled at (1696236): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.216091] softirqs last disabled at (1696227): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.216094] ---[ end trace 0000000000000000 ]--- <6> [117.216106] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <7> [117.216129] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [117.216199] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.216306] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.216361] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.216586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.216694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.216796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.216920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.217029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.217123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.217215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.217305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.217390] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.217491] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.217586] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.218627] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.229190] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.229450] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.230444] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.230530] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.230611] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.230692] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.230771] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.230859] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.230939] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.231017] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.231093] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.231170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.231247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.231322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.231399] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.231474] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.231551] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.231627] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.231703] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.231780] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.231864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.231951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.232035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.232115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.232192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.232272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.232349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.232425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.232502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.232578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.232653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.232732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.232812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.232906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.232985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.233063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.233147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.233230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.233313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.233393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.233471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.233547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.233624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.233701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.233781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.233867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.233945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.234023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.234101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.234175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.234250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.234327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.234406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.234481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.234557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.234632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.234708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.234785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.234867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.234941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.235017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.235095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.235172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.235249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.235325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.235400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.235478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.235555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.235629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.235704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.235783] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.236015] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.236023] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=42655, lrc_seqno=42655, guc_id=0, flags=0x73 in no process [-1] <7> [117.236028] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.236215] ------------[ cut here ]------------ <4> [117.236217] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.236219] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:2/119 <4> [117.236324] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.236401] CPU: 6 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.236405] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.236406] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.236408] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.236418] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.236503] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.236505] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [117.236508] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.236509] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.236510] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.236512] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.236513] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.236514] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [117.236516] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.236517] CR2: 00007372155ec008 CR3: 00000001450ef004 CR4: 0000000000f72ef0 <4> [117.236519] PKRU: 55555554 <4> [117.236520] Call Trace: <4> [117.236522] <TASK> <4> [117.236527] ? lock_acquire+0x60/0x300 <4> [117.236534] ? lock_release+0xd0/0x2b0 <4> [117.236539] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.236545] process_one_work+0x239/0x740 <4> [117.236553] worker_thread+0x200/0x3f0 <4> [117.236556] ? __pfx_worker_thread+0x10/0x10 <4> [117.236559] kthread+0x10d/0x150 <4> [117.236561] ? __pfx_kthread+0x10/0x10 <4> [117.236564] ret_from_fork+0x3bd/0x470 <4> [117.236567] ? __pfx_kthread+0x10/0x10 <4> [117.236570] ret_from_fork_asm+0x1a/0x30 <4> [117.236577] </TASK> <4> [117.236579] irq event stamp: 1698341 <4> [117.236580] hardirqs last enabled at (1698347): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.236582] hardirqs last disabled at (1698352): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.236584] softirqs last enabled at (1696236): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.236587] softirqs last disabled at (1696227): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.236590] ---[ end trace 0000000000000000 ]--- <6> [117.236593] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.236680] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.237423] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.237431] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [117.237548] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [117.237771] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.238172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.238271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.238370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.238466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.238558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.238645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.238733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.238822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.238923] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.239025] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.239120] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.240157] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.250844] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.251125] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.252184] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.252282] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.252371] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.252459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.252543] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.252627] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.252712] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.252797] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.252892] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.252974] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.253055] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.253137] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.253218] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.253300] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.253380] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.253461] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.253542] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.253623] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.253704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.253795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.253896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.253984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.254070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.254157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.254242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.254326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.254410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.254493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.254575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.254659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.254745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.254830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.254929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.255017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.255107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.255198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.255288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.255373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.255458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.255541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.255644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.255729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.255811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.255903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.255988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.256072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.256155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.256238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.256320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.256402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.256486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.256567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.256650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.256733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.256815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.256907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.256993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.257076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.257159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.257244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.257327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.257410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.257492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.257573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.257655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.257737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.257818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.257909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.257994] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.258119] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.258124] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=42655, lrc_seqno=42655, guc_id=0, flags=0x73 in no process [-1] <7> [117.258127] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.258199] ------------[ cut here ]------------ <4> [117.258200] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.258202] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:2/119 <4> [117.258285] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.258352] CPU: 6 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.258355] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.258357] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.258358] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.258364] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.258444] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.258446] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [117.258448] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.258450] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.258451] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.258452] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.258454] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.258455] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [117.258457] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.258458] CR2: 00007372155ec008 CR3: 00000001450ef004 CR4: 0000000000f72ef0 <4> [117.258460] PKRU: 55555554 <4> [117.258461] Call Trace: <4> [117.258462] <TASK> <4> [117.258466] ? lock_acquire+0x60/0x300 <4> [117.258472] ? lock_release+0xd0/0x2b0 <4> [117.258476] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.258483] process_one_work+0x239/0x740 <4> [117.258490] worker_thread+0x200/0x3f0 <4> [117.258493] ? __pfx_worker_thread+0x10/0x10 <4> [117.258495] kthread+0x10d/0x150 <4> [117.258498] ? __pfx_kthread+0x10/0x10 <4> [117.258500] ret_from_fork+0x3bd/0x470 <4> [117.258503] ? __pfx_kthread+0x10/0x10 <4> [117.258505] ret_from_fork_asm+0x1a/0x30 <4> [117.258513] </TASK> <4> [117.258514] irq event stamp: 1701817 <4> [117.258515] hardirqs last enabled at (1701823): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.258518] hardirqs last disabled at (1701828): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.258519] softirqs last enabled at (1700724): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.258522] softirqs last disabled at (1700717): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.258525] ---[ end trace 0000000000000000 ]--- <5> [117.259709] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=42710, lrc_seqno=42710, guc_id=0, flags=0x73 in no process [-1] <7> [117.259713] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.259790] ------------[ cut here ]------------ <4> [117.259791] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.259793] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:2/119 <4> [117.259884] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.259950] CPU: 6 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.259953] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.259954] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.259956] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.259961] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.260040] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.260042] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [117.260044] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.260045] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.260046] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.260048] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.260049] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.260050] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [117.260052] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.260053] CR2: 00007372155ec008 CR3: 00000001450ef004 CR4: 0000000000f72ef0 <4> [117.260054] PKRU: 55555554 <4> [117.260056] Call Trace: <4> [117.260057] <TASK> <4> [117.260060] ? lock_acquire+0x60/0x300 <4> [117.260065] ? lock_release+0xd0/0x2b0 <4> [117.260070] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.260076] process_one_work+0x239/0x740 <4> [117.260083] worker_thread+0x200/0x3f0 <4> [117.260086] ? __pfx_worker_thread+0x10/0x10 <4> [117.260088] kthread+0x10d/0x150 <4> [117.260091] ? __pfx_kthread+0x10/0x10 <4> [117.260094] ret_from_fork+0x3bd/0x470 <4> [117.260096] ? __pfx_kthread+0x10/0x10 <4> [117.260099] ret_from_fork_asm+0x1a/0x30 <4> [117.260106] </TASK> <4> [117.260107] irq event stamp: 1703539 <4> [117.260109] hardirqs last enabled at (1703545): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.260111] hardirqs last disabled at (1703550): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.260112] softirqs last enabled at (1702802): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.260115] softirqs last disabled at (1702791): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.260118] ---[ end trace 0000000000000000 ]--- <7> [117.260133] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [117.260249] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [117.260359] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.260440] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.260445] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.260641] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.260862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.260962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.261063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.261156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.261247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.261337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.261428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.261523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.261613] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.261718] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.261818] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.262872] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.272840] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.273102] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.274128] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.274220] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.274306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.274392] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.274476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.274560] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.274644] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.274727] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.274810] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.274905] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.274988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.275069] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.275152] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.275234] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.275316] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.275396] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.275478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.275562] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.275643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.275734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.275825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.275927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.276014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.276101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.276187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.276270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.276353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.276435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.276517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.276603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.276688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.276769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.276859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.276944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.277034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.277124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.277214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.277301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.277388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.277471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.277553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.277634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.277716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.277800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.277892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.277977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.278060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.278143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.278229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.278316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.278402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.278486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.278568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.278650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.278730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.278812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.278904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.278985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.279065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.279150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.279232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.279315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.279398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.279478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.279561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.279643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.279722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.279802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.279892] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.280017] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.280021] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=42710, lrc_seqno=42710, guc_id=0, flags=0x73 in no process [-1] <7> [117.280024] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.280095] ------------[ cut here ]------------ <4> [117.280096] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.280098] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:2/119 <4> [117.280181] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.280246] CPU: 6 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.280249] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.280250] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.280251] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.280257] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.280338] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.280339] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [117.280341] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.280343] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.280344] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.280345] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.280347] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.280348] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [117.280349] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.280351] CR2: 00007372155ec008 CR3: 00000001450ef004 CR4: 0000000000f72ef0 <4> [117.280352] PKRU: 55555554 <4> [117.280354] Call Trace: <4> [117.280355] <TASK> <4> [117.280359] ? lock_acquire+0x60/0x300 <4> [117.280364] ? lock_release+0xd0/0x2b0 <4> [117.280369] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.280375] process_one_work+0x239/0x740 <4> [117.280381] worker_thread+0x200/0x3f0 <4> [117.280384] ? __pfx_worker_thread+0x10/0x10 <4> [117.280387] kthread+0x10d/0x150 <4> [117.280389] ? __pfx_kthread+0x10/0x10 <4> [117.280392] ret_from_fork+0x3bd/0x470 <4> [117.280394] ? __pfx_kthread+0x10/0x10 <4> [117.280397] ret_from_fork_asm+0x1a/0x30 <4> [117.280404] </TASK> <4> [117.280405] irq event stamp: 1706705 <4> [117.280407] hardirqs last enabled at (1706711): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.280409] hardirqs last disabled at (1706716): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.280410] softirqs last enabled at (1705868): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.280413] softirqs last disabled at (1705861): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.280416] ---[ end trace 0000000000000000 ]--- <6> [117.280417] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.280499] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.280505] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.281739] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [117.281867] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [117.281983] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.282202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.282302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.282401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.282493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.282586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.282676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.282765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.282869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.282957] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.283059] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.283155] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.284192] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.295177] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.295434] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.296459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.296547] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.296628] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.296711] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.296791] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.296883] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.296961] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.297038] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.297115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.297193] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.297270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.297346] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.297421] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.297495] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.297570] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.297644] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.297718] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.297794] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.297881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.297966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.298051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.298131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.298215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.298297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.298381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.298460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.298537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.298613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.298697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.298779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.298870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.298953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.299035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.299115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.299199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.299283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.299367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.299448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.299528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.299603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.299680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.299755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.299829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.299920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.299999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.300079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.300156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.300231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.300304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.300380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.300459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.300534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.300611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.300685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.300758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.300837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.300915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.300990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.301064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.301142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.301218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.301294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.301371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.301446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.301522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.301599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.301672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.301746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.301824] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.301961] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.301966] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=42710, lrc_seqno=42710, guc_id=0, flags=0x73 in no process [-1] <7> [117.301968] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.302037] ------------[ cut here ]------------ <4> [117.302039] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.302040] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:5/202 <4> [117.302118] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.302185] CPU: 3 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.302188] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.302189] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.302191] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.302197] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.302274] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.302276] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.302278] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.302280] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.302281] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.302282] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.302283] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.302285] FS: 0000000000000000(0000) GS:ffff8888dae03000(0000) knlGS:0000000000000000 <4> [117.302286] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.302288] CR2: 00007d0de017c000 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [117.302289] PKRU: 55555554 <4> [117.302291] Call Trace: <4> [117.302292] <TASK> <4> [117.302296] ? lock_acquire+0x60/0x300 <4> [117.302301] ? lock_release+0xd0/0x2b0 <4> [117.302306] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.302312] process_one_work+0x239/0x740 <4> [117.302319] worker_thread+0x200/0x3f0 <4> [117.302322] ? __pfx_worker_thread+0x10/0x10 <4> [117.302325] kthread+0x10d/0x150 <4> [117.302327] ? __pfx_kthread+0x10/0x10 <4> [117.302330] ret_from_fork+0x3bd/0x470 <4> [117.302332] ? __pfx_kthread+0x10/0x10 <4> [117.302335] ret_from_fork_asm+0x1a/0x30 <4> [117.302342] </TASK> <4> [117.302343] irq event stamp: 1799505 <4> [117.302344] hardirqs last enabled at (1799511): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.302347] hardirqs last disabled at (1799516): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.302348] softirqs last enabled at (1798502): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.302351] softirqs last disabled at (1798495): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.302354] ---[ end trace 0000000000000000 ]--- <5> [117.302713] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=42765, lrc_seqno=42765, guc_id=0, flags=0x73 in no process [-1] <7> [117.303560] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.303636] ------------[ cut here ]------------ <4> [117.303638] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.303640] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:5/202 <4> [117.303725] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.303801] CPU: 3 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.303804] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.303806] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.303807] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.303813] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.303907] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.303909] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.303911] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.303913] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.303914] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.303915] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.303917] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.303918] FS: 0000000000000000(0000) GS:ffff8888dae03000(0000) knlGS:0000000000000000 <4> [117.303920] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.303921] CR2: 00007d0de017c000 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [117.303923] PKRU: 55555554 <4> [117.303924] Call Trace: <4> [117.303925] <TASK> <4> [117.303929] ? lock_acquire+0x60/0x300 <4> [117.303934] ? lock_release+0xd0/0x2b0 <4> [117.303939] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.303945] process_one_work+0x239/0x740 <4> [117.303951] worker_thread+0x200/0x3f0 <4> [117.303954] ? __pfx_worker_thread+0x10/0x10 <4> [117.303957] kthread+0x10d/0x150 <4> [117.303959] ? __pfx_kthread+0x10/0x10 <4> [117.303962] ret_from_fork+0x3bd/0x470 <4> [117.303965] ? __pfx_kthread+0x10/0x10 <4> [117.303967] ret_from_fork_asm+0x1a/0x30 <4> [117.303975] </TASK> <4> [117.303976] irq event stamp: 1801397 <4> [117.303977] hardirqs last enabled at (1801403): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.303979] hardirqs last disabled at (1801408): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.303981] softirqs last enabled at (1801236): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.303984] softirqs last disabled at (1801225): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.303987] ---[ end trace 0000000000000000 ]--- <7> [117.304002] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [117.304114] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [117.304218] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.304296] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.304305] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.304504] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.304726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.304827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.304970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.305069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.305167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.305262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.305356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.305450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.305538] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.305645] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.305745] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.306785] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.316841] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.317103] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.318116] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.318209] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.318296] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.318382] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.318466] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.318547] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.318626] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.318705] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.318784] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.318886] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.318967] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.319048] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.319127] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.319206] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.319285] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.319364] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.319444] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.319524] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.319603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.319712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.319803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.319900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.319985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.320073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.320157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.320239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.320321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.320404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.320490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.320575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.320659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.320743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.320827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.320924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.321014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.321104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.321193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.321279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.321364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.321446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.321529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.321611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.321692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.321776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.321870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.321955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.322038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.322119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.322203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.322286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.322371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.322456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.322540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.322622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.322705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.322791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.322880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.322960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.323041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.323124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.323206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.323289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.323370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.323453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.323538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.323620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.323700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.323780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.323871] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.323996] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.324000] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=42765, lrc_seqno=42765, guc_id=0, flags=0x73 in no process [-1] <7> [117.324003] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.324074] ------------[ cut here ]------------ <4> [117.324075] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.324077] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:2/119 <4> [117.324160] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.324225] CPU: 6 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.324228] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.324229] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.324230] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.324236] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.324317] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.324319] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [117.324321] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.324322] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.324324] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.324325] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.324326] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.324328] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [117.324329] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.324331] CR2: 00007372155ec008 CR3: 000000012c678001 CR4: 0000000000f72ef0 <4> [117.324332] PKRU: 55555554 <4> [117.324334] Call Trace: <4> [117.324335] <TASK> <4> [117.324339] ? lock_acquire+0x60/0x300 <4> [117.324344] ? lock_release+0xd0/0x2b0 <4> [117.324348] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.324355] process_one_work+0x239/0x740 <4> [117.324361] worker_thread+0x200/0x3f0 <4> [117.324364] ? __pfx_worker_thread+0x10/0x10 <4> [117.324367] kthread+0x10d/0x150 <4> [117.324369] ? __pfx_kthread+0x10/0x10 <4> [117.324372] ret_from_fork+0x3bd/0x470 <4> [117.324374] ? __pfx_kthread+0x10/0x10 <4> [117.324377] ret_from_fork_asm+0x1a/0x30 <4> [117.324385] </TASK> <4> [117.324386] irq event stamp: 1711207 <4> [117.324387] hardirqs last enabled at (1711213): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.324389] hardirqs last disabled at (1711218): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.324391] softirqs last enabled at (1710210): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.324394] softirqs last disabled at (1710187): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.324397] ---[ end trace 0000000000000000 ]--- <6> [117.324398] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.324478] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.324484] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.325730] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [117.325854] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [117.325971] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.326189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.326290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.326390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.326483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.326574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.326662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.326751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.326848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.326933] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.327036] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.327130] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.328166] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.339177] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.339434] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.340473] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.340560] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.340641] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.340721] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.340800] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.340891] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.340969] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.341047] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.341125] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.341202] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.341279] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.341355] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.341431] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.341508] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.341584] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.341659] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.341735] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.341811] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.341899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.341985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.342070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.342153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.342233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.342314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.342394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.342473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.342551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.342629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.342705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.342785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.342875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.342955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.343035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.343115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.343200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.343284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.343369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.343450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.343533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.343614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.343694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.343773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.343856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.343935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.344015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.344095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.344174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.344251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.344328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.344405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.344486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.344563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.344641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.344718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.344794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.344882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.344960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.345036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.345112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.345192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.345269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.345347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.345425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.345501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.345578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.345654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.345731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.345806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.345903] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.346026] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.346030] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=42765, lrc_seqno=42765, guc_id=0, flags=0x73 in no process [-1] <7> [117.346033] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.346101] ------------[ cut here ]------------ <4> [117.346103] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.346104] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:5/202 <4> [117.346182] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.346249] CPU: 3 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.346252] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.346253] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.346254] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.346260] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.346336] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.346338] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.346340] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.346342] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.346343] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.346344] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.346345] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.346346] FS: 0000000000000000(0000) GS:ffff8888dae03000(0000) knlGS:0000000000000000 <4> [117.346348] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.346349] CR2: 00007d0de017c000 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [117.346351] PKRU: 55555554 <4> [117.346352] Call Trace: <4> [117.346353] <TASK> <4> [117.346357] ? lock_acquire+0x60/0x300 <4> [117.346362] ? lock_release+0xd0/0x2b0 <4> [117.346367] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.346373] process_one_work+0x239/0x740 <4> [117.346379] worker_thread+0x200/0x3f0 <4> [117.346382] ? __pfx_worker_thread+0x10/0x10 <4> [117.346385] kthread+0x10d/0x150 <4> [117.346387] ? __pfx_kthread+0x10/0x10 <4> [117.346390] ret_from_fork+0x3bd/0x470 <4> [117.346392] ? __pfx_kthread+0x10/0x10 <4> [117.346395] ret_from_fork_asm+0x1a/0x30 <4> [117.346403] </TASK> <4> [117.346404] irq event stamp: 1804689 <4> [117.346405] hardirqs last enabled at (1804695): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.346407] hardirqs last disabled at (1804700): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.346409] softirqs last enabled at (1803852): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.346412] softirqs last disabled at (1803845): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.346414] ---[ end trace 0000000000000000 ]--- <7> [117.347579] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <5> [117.347760] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=42820, lrc_seqno=42820, guc_id=0, flags=0x73 in no process [-1] <7> [117.347719] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [117.347766] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.347892] ------------[ cut here ]------------ <4> [117.347894] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.347895] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:5/202 <4> [117.347978] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.348045] CPU: 2 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.348048] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.348050] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.348051] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.348058] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.348136] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.348138] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.348140] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.348142] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.348143] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.348145] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.348146] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.348148] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [117.348150] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.348151] CR2: 00007ad8440623b8 CR3: 000000012c678004 CR4: 0000000000f72ef0 <4> [117.348153] PKRU: 55555554 <4> [117.348154] Call Trace: <4> [117.348155] <TASK> <4> [117.348159] ? lock_acquire+0x60/0x300 <4> [117.348165] ? lock_release+0xd0/0x2b0 <4> [117.348170] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.348176] process_one_work+0x239/0x740 <4> [117.348183] worker_thread+0x200/0x3f0 <4> [117.348186] ? __pfx_worker_thread+0x10/0x10 <4> [117.348189] kthread+0x10d/0x150 <4> [117.348192] ? __pfx_kthread+0x10/0x10 <4> [117.348195] ret_from_fork+0x3bd/0x470 <4> [117.348197] ? __pfx_kthread+0x10/0x10 <4> [117.348200] ret_from_fork_asm+0x1a/0x30 <4> [117.348208] </TASK> <4> [117.348209] irq event stamp: 1806245 <4> [117.348211] hardirqs last enabled at (1806251): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.348213] hardirqs last disabled at (1806256): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.348215] softirqs last enabled at (1805490): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.348218] softirqs last disabled at (1805485): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.348221] ---[ end trace 0000000000000000 ]--- <6> [117.348223] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.348300] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.348306] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.348389] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.348601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.348696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.348793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.348898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.348989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.349078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.349166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.349257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.349341] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.349442] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.349536] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.350574] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.360855] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.361137] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.362353] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.362443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.362525] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.362607] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.362687] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.362766] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.362852] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.362933] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.363013] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.363090] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.363167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.363243] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.363320] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.363396] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.363472] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.363548] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.363624] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.363700] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.363777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.363875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.363961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.364042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.364120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.364200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.364279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.364355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.364431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.364508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.364585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.364664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.364744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.364822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.364915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.364994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.365078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.365161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.365244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.365324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.365403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.365480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.365557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.365634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.365711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.365789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.365880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.365962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.366045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.366125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.366201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.366282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.366364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.366442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.366520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.366596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.366673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.366749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.366840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.366916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.366990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.367068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.367143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.367220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.367300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.367377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.367455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.367532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.367607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.367682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.367761] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.367888] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.367893] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=42820, lrc_seqno=42820, guc_id=0, flags=0x73 in no process [-1] <7> [117.367895] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.367962] ------------[ cut here ]------------ <4> [117.367964] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.367965] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:5/202 <4> [117.368043] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.368109] CPU: 2 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.368112] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.368113] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.368115] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.368121] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.368196] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.368198] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.368200] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.368201] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.368203] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.368204] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.368205] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.368207] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [117.368208] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.368210] CR2: 00007ad8440623b8 CR3: 000000012c678004 CR4: 0000000000f72ef0 <4> [117.368211] PKRU: 55555554 <4> [117.368212] Call Trace: <4> [117.368214] <TASK> <4> [117.368218] ? lock_acquire+0x60/0x300 <4> [117.368222] ? lock_release+0xd0/0x2b0 <4> [117.368227] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.368234] process_one_work+0x239/0x740 <4> [117.368240] worker_thread+0x200/0x3f0 <4> [117.368243] ? __pfx_worker_thread+0x10/0x10 <4> [117.368246] kthread+0x10d/0x150 <4> [117.368248] ? __pfx_kthread+0x10/0x10 <4> [117.368251] ret_from_fork+0x3bd/0x470 <4> [117.368253] ? __pfx_kthread+0x10/0x10 <4> [117.368256] ret_from_fork_asm+0x1a/0x30 <4> [117.368264] </TASK> <4> [117.368265] irq event stamp: 1809375 <4> [117.368266] hardirqs last enabled at (1809381): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.368268] hardirqs last disabled at (1809386): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.368270] softirqs last enabled at (1808090): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.368273] softirqs last disabled at (1808085): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.368275] ---[ end trace 0000000000000000 ]--- <6> [117.368277] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.368354] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.368360] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.369602] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [117.369715] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [117.369826] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.370087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.370188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.370287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.370380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.370472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.370563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.370653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.370742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.370826] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.370944] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.371038] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.372072] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.381841] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.382097] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.383091] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.383178] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.383259] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.383339] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.383420] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.383498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.383576] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.383652] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.383728] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.383803] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.383891] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.383968] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.384042] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.384118] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.384193] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.384268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.384343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.384418] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.384493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.384578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.384663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.384745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.384823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.384918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.384999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.385078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.385156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.385234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.385312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.385393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.385474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.385554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.385633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.385712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.385797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.385890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.385975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.386057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.386138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.386217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.386296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.386372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.386448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.386525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.386604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.386680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.386758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.386866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.386968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.387057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.387145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.387229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.387312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.387395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.387478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.387559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.387643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.387723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.387801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.387896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.387976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.388055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.388136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.388214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.388293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.388371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.388447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.388523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.388602] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.388728] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.388732] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=42820, lrc_seqno=42820, guc_id=0, flags=0x73 in no process [-1] <7> [117.388734] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.388802] ------------[ cut here ]------------ <4> [117.388803] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.388805] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:8/1979 <4> [117.388904] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.388972] CPU: 3 UID: 0 PID: 1979 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.388975] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.388977] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.388978] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.388984] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.389063] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.389065] RSP: 0018:ffffc90001a5fca0 EFLAGS: 00010246 <4> [117.389067] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.389068] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.389070] RBP: ffffc90001a5fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.389071] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.389072] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.389073] FS: 0000000000000000(0000) GS:ffff8888dae03000(0000) knlGS:0000000000000000 <4> [117.389075] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.389076] CR2: 00007d0de017c000 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [117.389078] PKRU: 55555554 <4> [117.389079] Call Trace: <4> [117.389080] <TASK> <4> [117.389084] ? lock_acquire+0x60/0x300 <4> [117.389090] ? lock_release+0xd0/0x2b0 <4> [117.389094] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.389100] process_one_work+0x239/0x740 <4> [117.389107] worker_thread+0x200/0x3f0 <4> [117.389110] ? __pfx_worker_thread+0x10/0x10 <4> [117.389113] kthread+0x10d/0x150 <4> [117.389115] ? __pfx_kthread+0x10/0x10 <4> [117.389118] ret_from_fork+0x3bd/0x470 <4> [117.389120] ? __pfx_kthread+0x10/0x10 <4> [117.389123] ret_from_fork_asm+0x1a/0x30 <4> [117.389130] </TASK> <4> [117.389131] irq event stamp: 281289 <4> [117.389133] hardirqs last enabled at (281295): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.389135] hardirqs last disabled at (281300): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.389137] softirqs last enabled at (280392): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.389139] softirqs last disabled at (280387): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.389142] ---[ end trace 0000000000000000 ]--- <5> [117.390337] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=42875, lrc_seqno=42875, guc_id=0, flags=0x73 in no process [-1] <7> [117.390342] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.390421] ------------[ cut here ]------------ <4> [117.390422] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [117.390401] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [117.390424] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:8/1979 <4> [117.390514] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake <7> [117.390515] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [117.390567] intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.390583] CPU: 1 UID: 0 PID: 1979 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.390586] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.390587] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.390588] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.390594] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.390673] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.390675] RSP: 0018:ffffc90001a5fca0 EFLAGS: 00010246 <4> [117.390678] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.390679] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.390680] RBP: ffffc90001a5fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.390682] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.390683] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.390684] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [117.390686] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.390687] CR2: 00007ad854e8a000 CR3: 000000012c678003 CR4: 0000000000f72ef0 <4> [117.390689] PKRU: 55555554 <4> [117.390690] Call Trace: <4> [117.390691] <TASK> <4> [117.390695] ? lock_acquire+0x60/0x300 <4> [117.390700] ? lock_release+0xd0/0x2b0 <4> [117.390705] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.390711] process_one_work+0x239/0x740 <4> [117.390718] worker_thread+0x200/0x3f0 <4> [117.390721] ? __pfx_worker_thread+0x10/0x10 <4> [117.390724] kthread+0x10d/0x150 <4> [117.390726] ? __pfx_kthread+0x10/0x10 <4> [117.390729] ret_from_fork+0x3bd/0x470 <4> [117.390731] ? __pfx_kthread+0x10/0x10 <4> [117.390734] ret_from_fork_asm+0x1a/0x30 <4> [117.390741] </TASK> <4> [117.390743] irq event stamp: 283291 <4> [117.390744] hardirqs last enabled at (283297): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.390746] hardirqs last disabled at (283302): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.390748] softirqs last enabled at (280392): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.390751] softirqs last disabled at (280387): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.390753] ---[ end trace 0000000000000000 ]--- <6> [117.390755] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.390844] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.390854] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.390959] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.391270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.391370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.391469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.391560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.391650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.391738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.391826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.391929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.392015] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.392116] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.392209] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.393242] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.403841] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.404099] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.405124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.405201] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.405275] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.405350] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.405421] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.405492] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.405562] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.405633] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.405703] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.405773] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.405850] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.405930] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.406007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.406082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.406158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.406233] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.406307] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.406384] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.406459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.406545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.406629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.406711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.406791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.406887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.406967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.407046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.407124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.407201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.407277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.407358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.407438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.407517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.407597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.407677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.407761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.407850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.407936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.408018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.408099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.408177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.408258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.408339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.408417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.408495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.408573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.408652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.408729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.408805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.408888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.408966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.409045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.409121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.409199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.409276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.409353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.409431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.409508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.409583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.409657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.409736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.409813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.409903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.409981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.410057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.410135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.410212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.410287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.410363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.410441] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.410563] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.410567] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=42875, lrc_seqno=42875, guc_id=0, flags=0x73 in no process [-1] <7> [117.410569] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.410636] ------------[ cut here ]------------ <4> [117.410637] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.410639] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:8/1979 <4> [117.410716] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.410782] CPU: 1 UID: 0 PID: 1979 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.410785] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.410786] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.410787] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.410793] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.410882] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.410884] RSP: 0018:ffffc90001a5fca0 EFLAGS: 00010246 <4> [117.410886] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.410888] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.410890] RBP: ffffc90001a5fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.410891] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.410893] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.410894] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [117.410896] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.410897] CR2: 00007ad854e8a000 CR3: 000000012c678003 CR4: 0000000000f72ef0 <4> [117.410899] PKRU: 55555554 <4> [117.410900] Call Trace: <4> [117.410901] <TASK> <4> [117.410905] ? lock_acquire+0x60/0x300 <4> [117.410910] ? lock_release+0xd0/0x2b0 <4> [117.410915] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.410922] process_one_work+0x239/0x740 <4> [117.410929] worker_thread+0x200/0x3f0 <4> [117.410932] ? __pfx_worker_thread+0x10/0x10 <4> [117.410935] kthread+0x10d/0x150 <4> [117.410937] ? __pfx_kthread+0x10/0x10 <4> [117.410940] ret_from_fork+0x3bd/0x470 <4> [117.410942] ? __pfx_kthread+0x10/0x10 <4> [117.410945] ret_from_fork_asm+0x1a/0x30 <4> [117.410953] </TASK> <4> [117.410954] irq event stamp: 286429 <4> [117.410955] hardirqs last enabled at (286435): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.410957] hardirqs last disabled at (286440): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.410959] softirqs last enabled at (285276): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.410962] softirqs last disabled at (285269): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.410965] ---[ end trace 0000000000000000 ]--- <6> [117.412120] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.412200] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.412206] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.412221] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [117.412333] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [117.412442] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.412658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.412753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.412866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.412960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.413049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.413135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.413221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.413309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.413391] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.413492] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.413585] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.414623] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.424842] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.425099] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.426077] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.426158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.426239] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.426320] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.426398] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.426476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.426555] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.426633] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.426710] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.426787] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.426888] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.426970] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.427049] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.427127] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.427205] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.427281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.427357] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.427433] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.427508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.427593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.427678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.427759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.427846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.427929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.428009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.428086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.428164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.428239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.428314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.428393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.428473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.428551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.428628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.428707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.428795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.428892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.428977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.429056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.429136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.429213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.429291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.429367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.429443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.429521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.429600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.429676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.429754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.429829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.429921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.429999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.430080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.430156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.430233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.430309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.430386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.430463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.430540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.430616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.430691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.430769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.430852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.430931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.431008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.431083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.431160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.431237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.431313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.431387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.431466] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.431586] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.431591] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=42875, lrc_seqno=42875, guc_id=0, flags=0x73 in no process [-1] <7> [117.431593] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.431661] ------------[ cut here ]------------ <4> [117.431662] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.431663] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:5/202 <4> [117.431750] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.431816] CPU: 3 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.431819] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.431820] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.431822] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.431828] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.431920] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.431922] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.431925] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.431927] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.431929] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.431930] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.431931] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.431933] FS: 0000000000000000(0000) GS:ffff8888dae03000(0000) knlGS:0000000000000000 <4> [117.431935] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.431936] CR2: 00007d0de017c000 CR3: 000000012c678006 CR4: 0000000000f72ef0 <4> [117.431938] PKRU: 55555554 <4> [117.431939] Call Trace: <4> [117.431940] <TASK> <4> [117.431944] ? lock_acquire+0x60/0x300 <4> [117.431949] ? lock_release+0xd0/0x2b0 <4> [117.431954] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.431961] process_one_work+0x239/0x740 <4> [117.431967] worker_thread+0x200/0x3f0 <4> [117.431971] ? __pfx_worker_thread+0x10/0x10 <4> [117.431973] kthread+0x10d/0x150 <4> [117.431976] ? __pfx_kthread+0x10/0x10 <4> [117.431979] ret_from_fork+0x3bd/0x470 <4> [117.431981] ? __pfx_kthread+0x10/0x10 <4> [117.431984] ret_from_fork_asm+0x1a/0x30 <4> [117.431992] </TASK> <4> [117.431993] irq event stamp: 1814215 <4> [117.431994] hardirqs last enabled at (1814221): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.431996] hardirqs last disabled at (1814226): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.431998] softirqs last enabled at (1813146): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.432001] softirqs last disabled at (1813141): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.432004] ---[ end trace 0000000000000000 ]--- <7> [117.433524] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [117.433640] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [117.433695] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=42930, lrc_seqno=42930, guc_id=0, flags=0x73 in no process [-1] <7> [117.433700] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.433778] ------------[ cut here ]------------ <4> [117.433779] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.433780] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:5/202 <4> [117.433875] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.433943] CPU: 10 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.433945] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.433947] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.433948] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.433954] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.434033] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.434035] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.434037] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.434038] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.434040] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.434041] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.434042] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.434043] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [117.434045] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.434046] CR2: 00007d0de11e62f4 CR3: 000000012c678001 CR4: 0000000000f72ef0 <4> [117.434048] PKRU: 55555554 <4> [117.434049] Call Trace: <4> [117.434050] <TASK> <4> [117.434054] ? lock_acquire+0x60/0x300 <4> [117.434059] ? lock_release+0xd0/0x2b0 <4> [117.434064] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.434070] process_one_work+0x239/0x740 <4> [117.434077] worker_thread+0x200/0x3f0 <4> [117.434080] ? __pfx_worker_thread+0x10/0x10 <4> [117.434083] kthread+0x10d/0x150 <4> [117.434085] ? __pfx_kthread+0x10/0x10 <4> [117.434088] ret_from_fork+0x3bd/0x470 <4> [117.434090] ? __pfx_kthread+0x10/0x10 <4> [117.434093] ret_from_fork_asm+0x1a/0x30 <4> [117.434100] </TASK> <4> [117.434101] irq event stamp: 1816107 <4> [117.434102] hardirqs last enabled at (1816113): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.434105] hardirqs last disabled at (1816118): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.434106] softirqs last enabled at (1815370): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.434109] softirqs last disabled at (1815365): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.434112] ---[ end trace 0000000000000000 ]--- <6> [117.434114] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.434192] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.434199] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.434371] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.434585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.434683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.434780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.434881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.434987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.435074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.435163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.435254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.435338] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.435440] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.435534] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.436582] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.446846] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.447109] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.448163] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.448242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.448317] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.448390] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.448464] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.448536] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.448610] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.448683] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.448754] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.448823] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.448914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.448991] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.449068] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.449143] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.449218] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.449293] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.449368] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.449444] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.449517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.449603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.449686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.449768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.449854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.449935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.450015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.450094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.450172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.450249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.450328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.450407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.450492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.450571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.450650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.450730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.450815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.450909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.450993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.451075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.451156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.451232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.451310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.451388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.451465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.451542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.451621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.451699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.451777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.451857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.451933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.452010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.452093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.452172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.452251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.452329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.452406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.452483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.452559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.452634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.452709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.452788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.452877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.452956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.453035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.453112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.453190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.453268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.453342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.453418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.453498] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.453617] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.453621] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=42930, lrc_seqno=42930, guc_id=0, flags=0x73 in no process [-1] <7> [117.453623] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.453692] ------------[ cut here ]------------ <4> [117.453693] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.453694] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:5/202 <4> [117.453784] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.453854] CPU: 3 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.453857] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.453858] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.453859] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.453865] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.453941] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.453943] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.453945] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.453947] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.453948] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.453949] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.453950] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.453952] FS: 0000000000000000(0000) GS:ffff8888dae03000(0000) knlGS:0000000000000000 <4> [117.453953] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.453955] CR2: 00007d0de017c000 CR3: 000000012c678006 CR4: 0000000000f72ef0 <4> [117.453956] PKRU: 55555554 <4> [117.453957] Call Trace: <4> [117.453958] <TASK> <4> [117.453962] ? lock_acquire+0x60/0x300 <4> [117.453967] ? lock_release+0xd0/0x2b0 <4> [117.453972] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.453978] process_one_work+0x239/0x740 <4> [117.453985] worker_thread+0x200/0x3f0 <4> [117.453988] ? __pfx_worker_thread+0x10/0x10 <4> [117.453991] kthread+0x10d/0x150 <4> [117.453993] ? __pfx_kthread+0x10/0x10 <4> [117.453996] ret_from_fork+0x3bd/0x470 <4> [117.453998] ? __pfx_kthread+0x10/0x10 <4> [117.454001] ret_from_fork_asm+0x1a/0x30 <4> [117.454008] </TASK> <4> [117.454009] irq event stamp: 1819245 <4> [117.454010] hardirqs last enabled at (1819251): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.454013] hardirqs last disabled at (1819256): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.454014] softirqs last enabled at (1817990): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.454017] softirqs last disabled at (1817985): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.454020] ---[ end trace 0000000000000000 ]--- <6> [117.454855] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.455244] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.455253] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.455281] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [117.455390] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [117.455543] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.455778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.455897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.456004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.456104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.456199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.456293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.456388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.456484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.456574] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.456682] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.456782] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.457829] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.467841] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.468103] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.469127] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.469216] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.469302] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.469388] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.469473] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.469556] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.469640] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.469723] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.469806] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.469898] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.469980] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.470063] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.470144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.470226] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.470309] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.470391] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.470472] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.470557] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.470640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.470728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.470818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.470917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.471003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.471090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.471176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.471258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.471342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.471423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.471506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.471591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.471677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.471761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.471848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.471932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.472022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.472112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.472202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.472288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.472376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.472458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.472542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.472625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.472707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.472791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.472883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.472967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.473050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.473133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.473214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.473297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.473382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.473465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.473547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.473629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.473711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.473794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.473888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.473970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.474058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.474143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.474226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.474309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.474390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.474470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.474552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.474634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.474714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.474795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.474888] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.475014] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.475018] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=42930, lrc_seqno=42930, guc_id=0, flags=0x73 in no process [-1] <7> [117.475021] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.475093] ------------[ cut here ]------------ <4> [117.475094] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.475096] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:5/202 <4> [117.475180] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.475247] CPU: 8 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.475250] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.475251] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.475253] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.475259] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.475340] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.475342] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.475344] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.475346] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.475347] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.475348] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.475349] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.475351] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [117.475352] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.475354] CR2: 00007372155ee008 CR3: 000000012c678006 CR4: 0000000000f72ef0 <4> [117.475355] PKRU: 55555554 <4> [117.475357] Call Trace: <4> [117.475358] <TASK> <4> [117.475362] ? lock_acquire+0x60/0x300 <4> [117.475367] ? lock_release+0xd0/0x2b0 <4> [117.475372] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.475378] process_one_work+0x239/0x740 <4> [117.475385] worker_thread+0x200/0x3f0 <4> [117.475388] ? __pfx_worker_thread+0x10/0x10 <4> [117.475391] kthread+0x10d/0x150 <4> [117.475393] ? __pfx_kthread+0x10/0x10 <4> [117.475396] ret_from_fork+0x3bd/0x470 <4> [117.475398] ? __pfx_kthread+0x10/0x10 <4> [117.475400] ret_from_fork_asm+0x1a/0x30 <4> [117.475408] </TASK> <4> [117.475409] irq event stamp: 1822435 <4> [117.475410] hardirqs last enabled at (1822441): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.475413] hardirqs last disabled at (1822446): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.475414] softirqs last enabled at (1821598): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.475417] softirqs last disabled at (1821591): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.475420] ---[ end trace 0000000000000000 ]--- <5> [117.476856] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=42985, lrc_seqno=42985, guc_id=0, flags=0x73 in no process [-1] <7> [117.476861] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.476965] ------------[ cut here ]------------ <4> [117.476966] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.476968] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#9: kworker/u64:5/202 <4> [117.477059] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.477162] CPU: 9 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.477166] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.477168] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.477170] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.477178] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.477417] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.477420] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.477424] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.477426] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.477427] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.477429] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.477431] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.477433] FS: 0000000000000000(0000) GS:ffff8888db103000(0000) knlGS:0000000000000000 <4> [117.477436] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.477438] CR2: 0000000627e231d8 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [117.477440] PKRU: 55555554 <4> [117.477442] Call Trace: <4> [117.477444] <TASK> <4> [117.477450] ? lock_acquire+0x60/0x300 <4> [117.477457] ? lock_release+0xd0/0x2b0 <4> [117.477465] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.477475] process_one_work+0x239/0x740 <4> [117.477485] worker_thread+0x200/0x3f0 <4> [117.477490] ? __pfx_worker_thread+0x10/0x10 <4> [117.477495] kthread+0x10d/0x150 <4> [117.477498] ? __pfx_kthread+0x10/0x10 <4> [117.477504] ret_from_fork+0x3bd/0x470 <4> [117.477507] ? __pfx_kthread+0x10/0x10 <4> [117.477512] ret_from_fork_asm+0x1a/0x30 <4> [117.477525] </TASK> <4> [117.477527] irq event stamp: 1823945 <4> [117.477529] hardirqs last enabled at (1823951): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.477532] hardirqs last disabled at (1823956): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.477535] softirqs last enabled at (1821598): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.477538] softirqs last disabled at (1821591): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.477542] ---[ end trace 0000000000000000 ]--- <7> [117.477516] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <6> [117.477545] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.477668] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.477679] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.477681] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [117.477804] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.478034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.478132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.478230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.478320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.478407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.478492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.478577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.478665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.478748] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.478857] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.478952] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.480003] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.490734] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.490993] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.491984] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.492070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.492150] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.492232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.492309] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.492386] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.492462] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.492540] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.492617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.492696] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.492773] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.492862] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.492941] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.493017] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.493093] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.493168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.493243] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.493318] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.493394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.493479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.493563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.493645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.493724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.493804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.493895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.493974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.494051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.494129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.494208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.494291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.494373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.494454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.494534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.494614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.494698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.494782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.494876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.494956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.495036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.495113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.495190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.495267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.495344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.495421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.495500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.495578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.495654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.495730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.495806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.495898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.495978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.496054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.496131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.496207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.496283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.496361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.496437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.496512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.496587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.496666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.496744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.496824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.496915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.496993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.497071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.497149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.497224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.497300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.497378] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.497500] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.497504] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=42985, lrc_seqno=42985, guc_id=0, flags=0x73 in no process [-1] <7> [117.497507] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.497575] ------------[ cut here ]------------ <4> [117.497576] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.497577] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#9: kworker/u64:5/202 <4> [117.497655] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.497724] CPU: 9 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.497727] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.497728] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.497730] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.497735] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.497811] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.497813] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.497815] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.497816] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.497818] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.497819] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.497820] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.497821] FS: 0000000000000000(0000) GS:ffff8888db103000(0000) knlGS:0000000000000000 <4> [117.497823] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.497824] CR2: 0000000627e231d8 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [117.497826] PKRU: 55555554 <4> [117.497827] Call Trace: <4> [117.497828] <TASK> <4> [117.497835] ? lock_acquire+0x60/0x300 <4> [117.497840] ? lock_release+0xd0/0x2b0 <4> [117.497845] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.497852] process_one_work+0x239/0x740 <4> [117.497858] worker_thread+0x200/0x3f0 <4> [117.497862] ? __pfx_worker_thread+0x10/0x10 <4> [117.497864] kthread+0x10d/0x150 <4> [117.497866] ? __pfx_kthread+0x10/0x10 <4> [117.497869] ret_from_fork+0x3bd/0x470 <4> [117.497872] ? __pfx_kthread+0x10/0x10 <4> [117.497874] ret_from_fork_asm+0x1a/0x30 <4> [117.497882] </TASK> <4> [117.497883] irq event stamp: 1827127 <4> [117.497884] hardirqs last enabled at (1827133): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.497887] hardirqs last disabled at (1827138): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.497889] softirqs last enabled at (1826250): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.497892] softirqs last disabled at (1826243): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.497894] ---[ end trace 0000000000000000 ]--- <6> [117.498856] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.499096] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.499104] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.499147] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [117.499260] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [117.499370] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.499585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.499683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.499780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.499886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.499977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.500063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.500150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.500238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.500321] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.500422] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.500515] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.501552] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.511841] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.512122] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.513163] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.513248] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.513329] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.513410] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.513489] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.513570] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.513649] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.513724] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.513798] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.513883] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.513960] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.514037] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.514111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.514187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.514261] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.514337] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.514411] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.514487] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.514560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.514645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.514729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.514810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.514904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.514985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.515066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.515144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.515222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.515298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.515374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.515453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.515534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.515617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.515696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.515776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.515866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.515949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.516033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.516131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.516212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.516290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.516368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.516444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.516542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.516621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.516701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.516779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.516893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.516974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.517050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.517128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.517207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.517292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.517373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.517452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.517530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.517608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.517685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.517762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.517841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.517922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.517999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.518076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.518152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.518232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.518312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.518391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.518467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.518543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.518622] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.518742] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.518747] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=42985, lrc_seqno=42985, guc_id=0, flags=0x73 in no process [-1] <7> [117.518749] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.518817] ------------[ cut here ]------------ <4> [117.518818] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.518819] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:5/202 <4> [117.518910] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.518981] CPU: 1 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.518984] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.518986] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.518987] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.518993] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.519069] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.519071] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.519073] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.519075] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.519076] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.519077] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.519078] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.519080] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [117.519081] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.519083] CR2: 00007ad854e8a000 CR3: 000000012c678003 CR4: 0000000000f72ef0 <4> [117.519084] PKRU: 55555554 <4> [117.519085] Call Trace: <4> [117.519087] <TASK> <4> [117.519091] ? lock_acquire+0x60/0x300 <4> [117.519096] ? lock_release+0xd0/0x2b0 <4> [117.519100] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.519106] process_one_work+0x239/0x740 <4> [117.519113] worker_thread+0x200/0x3f0 <4> [117.519116] ? __pfx_worker_thread+0x10/0x10 <4> [117.519118] kthread+0x10d/0x150 <4> [117.519121] ? __pfx_kthread+0x10/0x10 <4> [117.519124] ret_from_fork+0x3bd/0x470 <4> [117.519126] ? __pfx_kthread+0x10/0x10 <4> [117.519129] ret_from_fork_asm+0x1a/0x30 <4> [117.519136] </TASK> <4> [117.519137] irq event stamp: 1830387 <4> [117.519139] hardirqs last enabled at (1830393): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.519141] hardirqs last disabled at (1830398): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.519142] softirqs last enabled at (1829484): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.519145] softirqs last disabled at (1829477): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.519148] ---[ end trace 0000000000000000 ]--- <7> [117.520568] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [117.520683] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [117.520788] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43040, lrc_seqno=43040, guc_id=0, flags=0x73 in no process [-1] <7> [117.520791] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.521084] ------------[ cut here ]------------ <4> [117.521086] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.521087] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:5/202 <4> [117.521170] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.521236] CPU: 1 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.521239] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.521240] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.521241] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.521247] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.521325] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.521327] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.521329] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.521330] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.521332] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.521333] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.521334] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.521336] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [117.521337] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.521338] CR2: 00007ad854e8a000 CR3: 000000012c678003 CR4: 0000000000f72ef0 <4> [117.521340] PKRU: 55555554 <4> [117.521341] Call Trace: <4> [117.521342] <TASK> <4> [117.521346] ? lock_acquire+0x60/0x300 <4> [117.521351] ? lock_release+0xd0/0x2b0 <4> [117.521356] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.521362] process_one_work+0x239/0x740 <4> [117.521369] worker_thread+0x200/0x3f0 <4> [117.521372] ? __pfx_worker_thread+0x10/0x10 <4> [117.521374] kthread+0x10d/0x150 <4> [117.521376] ? __pfx_kthread+0x10/0x10 <4> [117.521379] ret_from_fork+0x3bd/0x470 <4> [117.521381] ? __pfx_kthread+0x10/0x10 <4> [117.521384] ret_from_fork_asm+0x1a/0x30 <4> [117.521392] </TASK> <4> [117.521393] irq event stamp: 1832269 <4> [117.521394] hardirqs last enabled at (1832275): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.521396] hardirqs last disabled at (1832280): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.521398] softirqs last enabled at (1829484): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.521401] softirqs last disabled at (1829477): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.521404] ---[ end trace 0000000000000000 ]--- <6> [117.521405] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.521482] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.521488] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.521564] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.521775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.521882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.521980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.522072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.522162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.522251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.522340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.522430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.522514] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.522613] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.522708] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.523743] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.533841] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.534097] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.535120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.535207] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.535289] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.535369] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.535448] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.535525] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.535603] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.535681] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.535759] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.535841] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.535919] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.535995] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.536072] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.536147] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.536223] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.536297] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.536372] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.536446] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.536521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.536608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.536694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.536776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.536869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.536951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.537031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.537110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.537187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.537265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.537343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.537423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.537502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.537581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.537660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.537740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.537825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.537923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.538008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.538090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.538170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.538249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.538326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.538404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.538481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.538559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.538638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.538716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.538793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.538876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.538952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.539029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.539108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.539183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.539262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.539339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.539416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.539494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.539571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.539650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.539727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.539808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.539894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.539972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.540050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.540126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.540203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.540280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.540356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.540432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.540508] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.540628] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.540632] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43040, lrc_seqno=43040, guc_id=0, flags=0x73 in no process [-1] <7> [117.540634] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.540701] ------------[ cut here ]------------ <4> [117.540702] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.540704] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:5/202 <4> [117.540793] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.540871] CPU: 1 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.540874] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.540875] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.540877] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.540882] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.540959] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.540960] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.540963] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.540964] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.540965] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.540967] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.540968] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.540969] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [117.540971] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.540972] CR2: 00007ad854e8a000 CR3: 000000012c678003 CR4: 0000000000f72ef0 <4> [117.540973] PKRU: 55555554 <4> [117.540975] Call Trace: <4> [117.540976] <TASK> <4> [117.540980] ? lock_acquire+0x60/0x300 <4> [117.540985] ? lock_release+0xd0/0x2b0 <4> [117.540989] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.540995] process_one_work+0x239/0x740 <4> [117.541002] worker_thread+0x200/0x3f0 <4> [117.541005] ? __pfx_worker_thread+0x10/0x10 <4> [117.541008] kthread+0x10d/0x150 <4> [117.541010] ? __pfx_kthread+0x10/0x10 <4> [117.541013] ret_from_fork+0x3bd/0x470 <4> [117.541015] ? __pfx_kthread+0x10/0x10 <4> [117.541018] ret_from_fork_asm+0x1a/0x30 <4> [117.541026] </TASK> <4> [117.541027] irq event stamp: 1835431 <4> [117.541028] hardirqs last enabled at (1835437): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.541030] hardirqs last disabled at (1835442): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.541032] softirqs last enabled at (1834362): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.541035] softirqs last disabled at (1834355): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.541037] ---[ end trace 0000000000000000 ]--- <6> [117.541894] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.542043] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.542057] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.542285] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [117.542395] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [117.542504] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.542718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.542817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.542932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.543022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.543110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.543197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.543285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.543374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.543459] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.543560] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.543655] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.544691] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.554843] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.555100] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.556108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.556193] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.556274] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.556356] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.556436] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.556514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.556592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.556667] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.556743] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.556819] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.556914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.556994] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.557070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.557146] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.557223] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.557299] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.557376] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.557452] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.557528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.557614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.557699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.557783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.557906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.558003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.558095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.558174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.558252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.558329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.558405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.558485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.558570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.558649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.558727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.558805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.558902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.558987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.559070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.559149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.559227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.559304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.559380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.559463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.559539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.559617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.559695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.559776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.559861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.559939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.560016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.560093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.560174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.560250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.560328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.560405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.560480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.560556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.560633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.560708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.560783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.560874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.560950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.561027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.561104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.561179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.561255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.561332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.561407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.561482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.561560] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.561685] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.561689] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43040, lrc_seqno=43040, guc_id=0, flags=0x73 in no process [-1] <7> [117.561692] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.563060] ------------[ cut here ]------------ <4> [117.563062] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.563064] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:5/202 <4> [117.563151] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.563219] CPU: 3 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.563222] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.563224] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.563225] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.563231] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.563311] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.563312] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.563315] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.563316] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.563318] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.563319] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.563320] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.563321] FS: 0000000000000000(0000) GS:ffff8888dae03000(0000) knlGS:0000000000000000 <4> [117.563323] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.563324] CR2: 00007ad854e8c000 CR3: 000000011115e002 CR4: 0000000000f72ef0 <4> [117.563326] PKRU: 55555554 <4> [117.563327] Call Trace: <4> [117.563328] <TASK> <4> [117.563332] ? lock_acquire+0x60/0x300 <4> [117.563338] ? lock_release+0xd0/0x2b0 <4> [117.563342] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.563348] process_one_work+0x239/0x740 <4> [117.563355] worker_thread+0x200/0x3f0 <4> [117.563358] ? __pfx_worker_thread+0x10/0x10 <4> [117.563361] kthread+0x10d/0x150 <4> [117.563363] ? __pfx_kthread+0x10/0x10 <4> [117.563366] ret_from_fork+0x3bd/0x470 <4> [117.563369] ? __pfx_kthread+0x10/0x10 <4> [117.563371] ret_from_fork_asm+0x1a/0x30 <4> [117.563379] </TASK> <4> [117.563380] irq event stamp: 1838599 <4> [117.563381] hardirqs last enabled at (1838605): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.563383] hardirqs last disabled at (1838610): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.563385] softirqs last enabled at (1837698): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.563388] softirqs last disabled at (1837677): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.563390] ---[ end trace 0000000000000000 ]--- <5> [117.563744] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43095, lrc_seqno=43095, guc_id=0, flags=0x73 in no process [-1] <7> [117.563748] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [117.563753] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [117.563821] ------------[ cut here ]------------ <4> [117.563822] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.563823] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:5/202 <4> [117.563918] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.563985] CPU: 8 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.563988] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.563989] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.563991] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.563997] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <7> [117.564012] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [117.564074] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.564076] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.564078] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.564079] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.564080] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.564081] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.564082] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.564083] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [117.564085] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.564086] CR2: 00007372155ee008 CR3: 000000000344a001 CR4: 0000000000f72ef0 <4> [117.564087] PKRU: 55555554 <4> [117.564088] Call Trace: <4> [117.564089] <TASK> <4> [117.564093] ? lock_acquire+0x60/0x300 <4> [117.564098] ? lock_release+0xd0/0x2b0 <4> [117.564102] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.564108] process_one_work+0x239/0x740 <4> [117.564114] worker_thread+0x200/0x3f0 <4> [117.564118] ? __pfx_worker_thread+0x10/0x10 <4> [117.564120] kthread+0x10d/0x150 <4> [117.564123] ? __pfx_kthread+0x10/0x10 <4> [117.564126] ret_from_fork+0x3bd/0x470 <4> [117.564128] ? __pfx_kthread+0x10/0x10 <4> [117.564131] ret_from_fork_asm+0x1a/0x30 <4> [117.564139] </TASK> <4> [117.564140] irq event stamp: 1840461 <4> [117.564141] hardirqs last enabled at (1840467): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.564143] hardirqs last disabled at (1840472): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.564145] softirqs last enabled at (1839724): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.564148] softirqs last disabled at (1839717): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.564150] ---[ end trace 0000000000000000 ]--- <6> [117.564152] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.564232] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.564240] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.564288] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.564557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.564653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.564752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.564857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.564950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.565038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.565125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.565213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.565296] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.565398] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.565491] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.566537] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.576844] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.577127] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.578190] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.578276] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.578358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.578440] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.578519] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.578600] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.578678] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.578756] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.578832] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.578929] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.579029] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.579112] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.579190] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.579268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.579345] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.579422] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.579498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.579575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.579651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.579738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.579822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.579921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.580024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.580107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.580187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.580266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.580347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.580426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.580503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.580583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.580663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.580741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.580819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.580920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.581032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.581121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.581206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.581289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.581370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.581449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.581528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.581605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.581682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.581760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.581846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.581948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.582028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.582107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.582183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.582261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.582341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.582419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.582502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.582583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.582665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.582744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.582822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.582913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.583012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.583093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.583171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.583250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.583327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.583421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.583505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.583586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.583664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.583740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.583821] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.583962] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.583969] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43095, lrc_seqno=43095, guc_id=0, flags=0x73 in no process [-1] <7> [117.583973] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.584043] ------------[ cut here ]------------ <4> [117.584044] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.584045] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:8/1979 <4> [117.584125] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.584191] CPU: 2 UID: 0 PID: 1979 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.584194] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.584195] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.584197] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.584202] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.584277] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.584279] RSP: 0018:ffffc90001a5fca0 EFLAGS: 00010246 <4> [117.584282] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.584283] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.584284] RBP: ffffc90001a5fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.584285] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.584287] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.584288] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [117.584290] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.584291] CR2: 00007ad8440623b8 CR3: 000000000344a002 CR4: 0000000000f72ef0 <4> [117.584293] PKRU: 55555554 <4> [117.584294] Call Trace: <4> [117.584295] <TASK> <4> [117.584299] ? lock_acquire+0x60/0x300 <4> [117.584304] ? lock_release+0xd0/0x2b0 <4> [117.584309] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.584315] process_one_work+0x239/0x740 <4> [117.584322] worker_thread+0x200/0x3f0 <4> [117.584325] ? __pfx_worker_thread+0x10/0x10 <4> [117.584328] kthread+0x10d/0x150 <4> [117.584330] ? __pfx_kthread+0x10/0x10 <4> [117.584333] ret_from_fork+0x3bd/0x470 <4> [117.584335] ? __pfx_kthread+0x10/0x10 <4> [117.584338] ret_from_fork_asm+0x1a/0x30 <4> [117.584345] </TASK> <4> [117.584347] irq event stamp: 291043 <4> [117.584348] hardirqs last enabled at (291049): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.584350] hardirqs last disabled at (291054): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.584352] softirqs last enabled at (290046): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.584355] softirqs last disabled at (290039): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.584357] ---[ end trace 0000000000000000 ]--- <6> [117.584359] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.584435] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.584441] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.585683] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [117.585793] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [117.585915] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.586129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.586227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.586325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.586417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.586507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.586595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.586684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.586776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.586865] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.586967] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.587060] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.588096] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.597842] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.598099] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.599121] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.599207] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.599288] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.599370] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.599450] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.599530] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.599609] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.599687] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.599765] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.599845] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.599923] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.600000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.600076] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.600153] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.600229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.600306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.600382] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.600461] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.600538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.600625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.600710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.600792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.600881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.600963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.601043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.601121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.601199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.601276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.601352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.601432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.601512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.601591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.601671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.601750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.601838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.601923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.602006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.602086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.602165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.602242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.602319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.602396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.602472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.602550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.602630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.602712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.602793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.602880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.602958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.603036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.603117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.603199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.603281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.603359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.603439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.603518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.603600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.603676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.603752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.603831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.603932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.604011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.604089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.604165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.604243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.604320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.604395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.604471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.604549] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.604669] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.604673] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43095, lrc_seqno=43095, guc_id=0, flags=0x73 in no process [-1] <7> [117.604676] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.604743] ------------[ cut here ]------------ <4> [117.604745] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.604746] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:5/202 <4> [117.604824] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.604895] CPU: 8 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.604898] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.604899] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.604900] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.604906] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.604985] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.604986] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.604989] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.604990] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.604991] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.604993] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.604994] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.604995] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [117.604997] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.604998] CR2: 00007372155ee008 CR3: 000000000344a001 CR4: 0000000000f72ef0 <4> [117.605000] PKRU: 55555554 <4> [117.605001] Call Trace: <4> [117.605002] <TASK> <4> [117.605006] ? lock_acquire+0x60/0x300 <4> [117.605011] ? lock_release+0xd0/0x2b0 <4> [117.605016] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.605022] process_one_work+0x239/0x740 <4> [117.605028] worker_thread+0x200/0x3f0 <4> [117.605031] ? __pfx_worker_thread+0x10/0x10 <4> [117.605034] kthread+0x10d/0x150 <4> [117.605036] ? __pfx_kthread+0x10/0x10 <4> [117.605039] ret_from_fork+0x3bd/0x470 <4> [117.605041] ? __pfx_kthread+0x10/0x10 <4> [117.605044] ret_from_fork_asm+0x1a/0x30 <4> [117.605052] </TASK> <4> [117.605053] irq event stamp: 1844691 <4> [117.605054] hardirqs last enabled at (1844697): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.605056] hardirqs last disabled at (1844702): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.605058] softirqs last enabled at (1843802): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.605060] softirqs last disabled at (1843745): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.605063] ---[ end trace 0000000000000000 ]--- <5> [117.606457] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43150, lrc_seqno=43150, guc_id=0, flags=0x73 in no process [-1] <7> [117.606460] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.606531] ------------[ cut here ]------------ <4> [117.606532] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.606533] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:5/202 <4> [117.606610] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.606674] CPU: 8 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.606677] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.606678] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.606679] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.606684] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.606767] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.606769] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.606771] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.606772] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.606774] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.606775] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.606776] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.606777] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [117.606779] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.606780] CR2: 00007372155ee008 CR3: 000000000344a001 CR4: 0000000000f72ef0 <4> [117.606781] PKRU: 55555554 <4> [117.606783] Call Trace: <4> [117.606784] <TASK> <4> [117.606787] ? lock_acquire+0x60/0x300 <4> [117.606792] ? lock_release+0xd0/0x2b0 <4> [117.606797] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.606803] process_one_work+0x239/0x740 <4> [117.606809] worker_thread+0x200/0x3f0 <4> [117.606812] ? __pfx_worker_thread+0x10/0x10 <4> [117.606815] kthread+0x10d/0x150 <4> [117.606817] ? __pfx_kthread+0x10/0x10 <4> [117.606820] ret_from_fork+0x3bd/0x470 <4> [117.606822] ? __pfx_kthread+0x10/0x10 <4> [117.606825] ret_from_fork_asm+0x1a/0x30 <4> [117.606832] </TASK> <4> [117.606837] irq event stamp: 1846565 <4> [117.606838] hardirqs last enabled at (1846571): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.606840] hardirqs last disabled at (1846576): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.606842] softirqs last enabled at (1843802): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.606845] softirqs last disabled at (1843745): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.606848] ---[ end trace 0000000000000000 ]--- <7> [117.606862] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [117.606974] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [117.607076] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.607154] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.607160] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.607434] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.607658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.607761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.607867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.607959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.608049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.608137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.608225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.608314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.608398] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.608499] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.608593] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.609630] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.619892] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.620172] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.621213] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.621308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.621397] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.621484] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.621569] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.621654] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.621742] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.621826] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.621924] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.622008] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.622089] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.622169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.622251] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.622333] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.622414] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.622495] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.622577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.622657] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.622738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.622832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.622935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.623022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.623107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.623194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.623280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.623368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.623452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.623535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.623620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.623707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.623794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.623887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.623972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.624055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.624144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.624233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.624321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.624408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.624494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.624576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.624659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.624741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.624821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.624917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.625001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.625084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.625165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.625247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.625328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.625411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.625495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.625576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.625658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.625740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.625819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.625911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.625992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.626076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.626158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.626243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.626324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.626406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.626488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.626570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.626652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.626734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.626813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.626900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.626985] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.627111] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.627116] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43150, lrc_seqno=43150, guc_id=0, flags=0x73 in no process [-1] <7> [117.627119] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.627191] ------------[ cut here ]------------ <4> [117.627192] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.627193] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:2/119 <4> [117.627277] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.627344] CPU: 6 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.627347] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.627348] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.627350] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.627355] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.627436] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.627438] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [117.627440] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.627442] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.627443] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.627444] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.627446] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.627447] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [117.627449] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.627450] CR2: 00007372155f0008 CR3: 00000001450ef004 CR4: 0000000000f72ef0 <4> [117.627452] PKRU: 55555554 <4> [117.627453] Call Trace: <4> [117.627454] <TASK> <4> [117.627458] ? lock_acquire+0x60/0x300 <4> [117.627463] ? lock_release+0xd0/0x2b0 <4> [117.627468] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.627474] process_one_work+0x239/0x740 <4> [117.627481] worker_thread+0x200/0x3f0 <4> [117.627484] ? __pfx_worker_thread+0x10/0x10 <4> [117.627487] kthread+0x10d/0x150 <4> [117.627489] ? __pfx_kthread+0x10/0x10 <4> [117.627492] ret_from_fork+0x3bd/0x470 <4> [117.627494] ? __pfx_kthread+0x10/0x10 <4> [117.627497] ret_from_fork_asm+0x1a/0x30 <4> [117.627505] </TASK> <4> [117.627506] irq event stamp: 1724255 <4> [117.627507] hardirqs last enabled at (1724261): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.627509] hardirqs last disabled at (1724266): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.627511] softirqs last enabled at (1723252): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.627514] softirqs last disabled at (1723243): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.627516] ---[ end trace 0000000000000000 ]--- <6> [117.627518] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.627599] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.627605] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.628842] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [117.628961] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [117.629077] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.629288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.629382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.629478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.629568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.629657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.629745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.629837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.629927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.630011] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.630111] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.630206] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.631239] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.640841] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.641108] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.642157] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.642247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.642331] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.642415] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.642496] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.642576] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.642653] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.642732] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.642813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.642906] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.642985] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.643062] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.643140] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.643216] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.643292] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.643367] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.643442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.643517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.643591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.643678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.643765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.643851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.643932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.644013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.644095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.644174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.644252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.644328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.644405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.644485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.644568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.644646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.644726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.644805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.644899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.644984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.645069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.645152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.645234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.645312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.645391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.645469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.645544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.645622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.645700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.645777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.645863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.645942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.646019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.646095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.646174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.646252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.646332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.646413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.646491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.646570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.646647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.646723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.646800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.646887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.646965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.647042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.647119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.647194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.647270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.647347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.647420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.647495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.647574] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.647697] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.647701] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43150, lrc_seqno=43150, guc_id=0, flags=0x73 in no process [-1] <7> [117.647704] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.647772] ------------[ cut here ]------------ <4> [117.647773] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.647774] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:5/202 <4> [117.647859] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.647926] CPU: 3 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.647929] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.647930] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.647932] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.647938] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.648014] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.648016] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.648018] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.648019] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.648021] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.648022] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.648023] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.648025] FS: 0000000000000000(0000) GS:ffff8888dae03000(0000) knlGS:0000000000000000 <4> [117.648026] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.648028] CR2: 00007ad854e8c000 CR3: 000000012c678006 CR4: 0000000000f72ef0 <4> [117.648029] PKRU: 55555554 <4> [117.648030] Call Trace: <4> [117.648031] <TASK> <4> [117.648035] ? lock_acquire+0x60/0x300 <4> [117.648040] ? lock_release+0xd0/0x2b0 <4> [117.648045] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.648051] process_one_work+0x239/0x740 <4> [117.648058] worker_thread+0x200/0x3f0 <4> [117.648061] ? __pfx_worker_thread+0x10/0x10 <4> [117.648063] kthread+0x10d/0x150 <4> [117.648066] ? __pfx_kthread+0x10/0x10 <4> [117.648069] ret_from_fork+0x3bd/0x470 <4> [117.648071] ? __pfx_kthread+0x10/0x10 <4> [117.648073] ret_from_fork_asm+0x1a/0x30 <4> [117.648081] </TASK> <4> [117.648082] irq event stamp: 1850763 <4> [117.648083] hardirqs last enabled at (1850769): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.648086] hardirqs last disabled at (1850774): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.648087] softirqs last enabled at (1850026): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.648090] softirqs last disabled at (1850021): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.648093] ---[ end trace 0000000000000000 ]--- <5> [117.648467] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43205, lrc_seqno=43205, guc_id=0, flags=0x73 in no process [-1] <7> [117.648522] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.648937] ------------[ cut here ]------------ <4> [117.648940] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.648941] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:5/202 <4> [117.649068] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.649142] CPU: 8 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.649147] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.649148] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.649149] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.649159] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.649245] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.649246] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.649249] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.649250] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.649252] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.649253] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.649254] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.649255] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [117.649257] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.649258] CR2: 00007372155ee008 CR3: 000000012c678006 CR4: 0000000000f72ef0 <4> [117.649260] PKRU: 55555554 <4> [117.649262] Call Trace: <4> [117.649264] <TASK> <4> [117.649269] ? lock_acquire+0x60/0x300 <4> [117.649276] ? lock_release+0xd0/0x2b0 <4> [117.649281] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.649289] process_one_work+0x239/0x740 <4> [117.649296] worker_thread+0x200/0x3f0 <4> [117.649299] ? __pfx_worker_thread+0x10/0x10 <4> [117.649302] kthread+0x10d/0x150 <4> [117.649304] ? __pfx_kthread+0x10/0x10 <4> [117.649307] ret_from_fork+0x3bd/0x470 <4> [117.649309] ? __pfx_kthread+0x10/0x10 <4> [117.649312] ret_from_fork_asm+0x1a/0x30 <4> [117.649319] </TASK> <4> [117.649320] irq event stamp: 1852707 <4> [117.649322] hardirqs last enabled at (1852713): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.649324] hardirqs last disabled at (1852718): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.649325] softirqs last enabled at (1851948): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.649328] softirqs last disabled at (1851943): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.649331] ---[ end trace 0000000000000000 ]--- <6> [117.649333] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.649408] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.649415] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.649404] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [117.649514] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [117.649623] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.649832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.649942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.650040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.650132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.650220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.650305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.650392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.650480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.650564] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.650664] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.650758] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.651792] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.662533] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.662790] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.663827] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.663925] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.664004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.664085] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.664170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.664248] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.664327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.664404] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.664482] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.664559] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.664636] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.664712] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.664788] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.664872] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.664947] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.665021] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.665096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.665172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.665247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.665332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.665415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.665494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.665572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.665653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.665732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.665809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.665899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.665977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.666055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.666133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.666213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.666291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.666368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.666447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.666532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.666616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.666699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.666779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.666867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.666943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.667021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.667096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.667170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.667249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.667330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.667407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.667483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.667560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.667638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.667716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.667795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.667878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.667956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.668032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.668107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.668184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.668259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.668334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.668407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.668486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.668562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.668639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.668715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.668790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.668875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.668951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.669026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.669100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.669178] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.669298] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.669302] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43205, lrc_seqno=43205, guc_id=0, flags=0x73 in no process [-1] <7> [117.669305] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.669372] ------------[ cut here ]------------ <4> [117.669373] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.669375] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:5/202 <4> [117.669452] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.669517] CPU: 8 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.669520] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.669521] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.669523] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.669528] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.669603] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.669605] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.669607] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.669609] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.669610] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.669611] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.669612] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.669614] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [117.669615] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.669617] CR2: 00007372155ee008 CR3: 000000000344a001 CR4: 0000000000f72ef0 <4> [117.669618] PKRU: 55555554 <4> [117.669619] Call Trace: <4> [117.669620] <TASK> <4> [117.669624] ? lock_acquire+0x60/0x300 <4> [117.669629] ? lock_release+0xd0/0x2b0 <4> [117.669634] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.669640] process_one_work+0x239/0x740 <4> [117.669647] worker_thread+0x200/0x3f0 <4> [117.669650] ? __pfx_worker_thread+0x10/0x10 <4> [117.669653] kthread+0x10d/0x150 <4> [117.669655] ? __pfx_kthread+0x10/0x10 <4> [117.669658] ret_from_fork+0x3bd/0x470 <4> [117.669660] ? __pfx_kthread+0x10/0x10 <4> [117.669665] ret_from_fork_asm+0x1a/0x30 <4> [117.669672] </TASK> <4> [117.669673] irq event stamp: 1855893 <4> [117.669675] hardirqs last enabled at (1855899): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.669677] hardirqs last disabled at (1855904): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.669678] softirqs last enabled at (1855030): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.669681] softirqs last disabled at (1855025): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.669684] ---[ end trace 0000000000000000 ]--- <6> [117.669869] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.670283] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.670305] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.670715] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [117.670830] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [117.670962] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.671176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.671270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.671367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.671458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.671548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.671638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.671729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.671821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.671924] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.672025] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.672121] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.673155] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.683856] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.684113] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.685173] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.685258] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.685337] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.685418] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.685497] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.685576] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.685654] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.685731] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.685808] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.685899] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.685977] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.686053] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.686131] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.686207] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.686284] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.686359] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.686436] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.686511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.686587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.686672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.686758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.686845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.686923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.687002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.687081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.687155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.687231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.687307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.687382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.687459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.687538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.687614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.687692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.687770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.687858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.687943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.688026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.688106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.688185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.688262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.688343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.688420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.688496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.688573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.688651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.688728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.688806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.688894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.688971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.689048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.689127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.689202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.689280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.689357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.689432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.689508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.689584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.689659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.689733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.689810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.689897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.689975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.690050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.690125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.690201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.690277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.690351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.690426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.690503] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.690623] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.690627] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43205, lrc_seqno=43205, guc_id=0, flags=0x73 in no process [-1] <7> [117.690630] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.690697] ------------[ cut here ]------------ <4> [117.690698] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.690700] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#9: kworker/u64:5/202 <4> [117.690777] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.690849] CPU: 9 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.690853] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.690854] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.690855] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.690861] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.690937] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.690939] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.690941] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.690943] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.690944] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.690945] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.690947] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.690948] FS: 0000000000000000(0000) GS:ffff8888db103000(0000) knlGS:0000000000000000 <4> [117.690950] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.690951] CR2: 0000000627e231d8 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [117.690953] PKRU: 55555554 <4> [117.690954] Call Trace: <4> [117.690955] <TASK> <4> [117.690959] ? lock_acquire+0x60/0x300 <4> [117.690964] ? lock_release+0xd0/0x2b0 <4> [117.690969] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.690975] process_one_work+0x239/0x740 <4> [117.690981] worker_thread+0x200/0x3f0 <4> [117.690984] ? __pfx_worker_thread+0x10/0x10 <4> [117.690987] kthread+0x10d/0x150 <4> [117.690989] ? __pfx_kthread+0x10/0x10 <4> [117.690992] ret_from_fork+0x3bd/0x470 <4> [117.690994] ? __pfx_kthread+0x10/0x10 <4> [117.690997] ret_from_fork_asm+0x1a/0x30 <4> [117.691005] </TASK> <4> [117.691006] irq event stamp: 1859053 <4> [117.691007] hardirqs last enabled at (1859059): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.691009] hardirqs last disabled at (1859064): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.691011] softirqs last enabled at (1857888): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.691014] softirqs last disabled at (1857881): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.691016] ---[ end trace 0000000000000000 ]--- <5> [117.692218] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43260, lrc_seqno=43260, guc_id=0, flags=0x73 in no process [-1] <7> [117.692222] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.692309] ------------[ cut here ]------------ <4> [117.692310] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.692312] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#9: kworker/u64:5/202 <4> [117.692393] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.692458] CPU: 9 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.692460] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.692461] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.692463] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.692468] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.692546] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.692548] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.692550] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.692552] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.692553] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.692554] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.692555] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.692557] FS: 0000000000000000(0000) GS:ffff8888db103000(0000) knlGS:0000000000000000 <4> [117.692558] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.692560] CR2: 0000000627e231d8 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [117.692561] PKRU: 55555554 <4> [117.692562] Call Trace: <4> [117.692563] <TASK> <4> [117.692567] ? lock_acquire+0x60/0x300 <4> [117.692572] ? lock_release+0xd0/0x2b0 <4> [117.692576] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.692582] process_one_work+0x239/0x740 <4> [117.692589] worker_thread+0x200/0x3f0 <4> [117.692592] ? __pfx_worker_thread+0x10/0x10 <4> [117.692594] kthread+0x10d/0x150 <4> [117.692596] ? __pfx_kthread+0x10/0x10 <4> [117.692599] ret_from_fork+0x3bd/0x470 <4> [117.692602] ? __pfx_kthread+0x10/0x10 <4> [117.692604] ret_from_fork_asm+0x1a/0x30 <4> [117.692612] </TASK> <4> [117.692613] irq event stamp: 1860931 <4> [117.692614] hardirqs last enabled at (1860937): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.692616] hardirqs last disabled at (1860942): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.692618] softirqs last enabled at (1857888): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.692620] softirqs last disabled at (1857881): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.692623] ---[ end trace 0000000000000000 ]--- <7> [117.692637] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [117.692748] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [117.692845] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.692934] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.692940] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.693146] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.693357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.693451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.693547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.693639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.693727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.693814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.693915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.694003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.694087] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.694187] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.694280] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.695317] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.706019] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.706276] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.707301] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.707386] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.707467] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.707547] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.707627] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.707705] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.707783] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.707873] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.707950] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.708026] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.708103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.708178] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.708256] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.708334] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.708412] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.708489] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.708566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.708643] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.708717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.708802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.708898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.708980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.709060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.709140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.709218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.709295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.709371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.709448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.709525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.709604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.709684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.709763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.709847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.709926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.710010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.710092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.710175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.710255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.710335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.710412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.710489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.710567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.710643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.710721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.710799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.710888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.710967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.711043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.711119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.711201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.711284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.711363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.711441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.711518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.711595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.711672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.711749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.711823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.711914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.711994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.712071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.712148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.712224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.712300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.712376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.712453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.712527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.712602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.712680] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.712799] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.712803] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43260, lrc_seqno=43260, guc_id=0, flags=0x73 in no process [-1] <7> [117.712806] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.712888] ------------[ cut here ]------------ <4> [117.712889] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.712891] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:5/202 <4> [117.712969] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.713034] CPU: 8 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.713037] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.713038] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.713039] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.713045] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.713120] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.713122] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.713124] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.713126] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.713127] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.713128] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.713129] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.713131] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [117.713132] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.713134] CR2: 00007372155ee008 CR3: 000000000344a001 CR4: 0000000000f72ef0 <4> [117.713135] PKRU: 55555554 <4> [117.713136] Call Trace: <4> [117.713137] <TASK> <4> [117.713141] ? lock_acquire+0x60/0x300 <4> [117.713146] ? lock_release+0xd0/0x2b0 <4> [117.713151] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.713157] process_one_work+0x239/0x740 <4> [117.713164] worker_thread+0x200/0x3f0 <4> [117.713167] ? __pfx_worker_thread+0x10/0x10 <4> [117.713170] kthread+0x10d/0x150 <4> [117.713172] ? __pfx_kthread+0x10/0x10 <4> [117.713175] ret_from_fork+0x3bd/0x470 <4> [117.713177] ? __pfx_kthread+0x10/0x10 <4> [117.713180] ret_from_fork_asm+0x1a/0x30 <4> [117.713187] </TASK> <4> [117.713188] irq event stamp: 1864101 <4> [117.713189] hardirqs last enabled at (1864107): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.713192] hardirqs last disabled at (1864112): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.713193] softirqs last enabled at (1863346): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.713196] softirqs last disabled at (1863339): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.713199] ---[ end trace 0000000000000000 ]--- <6> [117.713201] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.713276] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.713281] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.713696] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.713909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.713999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.714091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.714177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.714262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.714348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.714432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.714519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.714601] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.714703] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.714797] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.715833] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.726576] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.726833] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.727879] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.727965] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.728045] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.728125] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.728202] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.728281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.728361] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.728439] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.728515] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.728591] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.728667] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.728742] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.728818] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.728907] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.728988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.729064] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.729141] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.729216] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.729291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.729378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.729461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.729542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.729622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.729701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.729781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.729864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.729942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.730018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.730095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.730175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.730255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.730334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.730414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.730493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.730577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.730660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.730744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.730824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.730917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.730994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.731071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.731147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.731223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.731300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.731379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.731455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.731532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.731609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.731685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.731762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.731844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.731921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.731997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.732074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.732150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.732227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.732303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.732379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.732454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.732533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.732609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.732687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.732764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.732843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.732922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.732998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.733072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.733147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.733226] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.733344] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.733348] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43260, lrc_seqno=43260, guc_id=0, flags=0x73 in no process [-1] <7> [117.733350] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.733418] ------------[ cut here ]------------ <4> [117.733419] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.733421] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:5/202 <4> [117.733499] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.733564] CPU: 8 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.733567] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.733568] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.733569] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.733575] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.733651] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.733652] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.733655] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.733656] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.733657] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.733659] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.733660] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.733661] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [117.733663] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.733664] CR2: 00007372155ee008 CR3: 000000000344a001 CR4: 0000000000f72ef0 <4> [117.733665] PKRU: 55555554 <4> [117.733667] Call Trace: <4> [117.733668] <TASK> <4> [117.733672] ? lock_acquire+0x60/0x300 <4> [117.733677] ? lock_release+0xd0/0x2b0 <4> [117.733681] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.733687] process_one_work+0x239/0x740 <4> [117.733694] worker_thread+0x200/0x3f0 <4> [117.733697] ? __pfx_worker_thread+0x10/0x10 <4> [117.733699] kthread+0x10d/0x150 <4> [117.733702] ? __pfx_kthread+0x10/0x10 <4> [117.733705] ret_from_fork+0x3bd/0x470 <4> [117.733707] ? __pfx_kthread+0x10/0x10 <4> [117.733709] ret_from_fork_asm+0x1a/0x30 <4> [117.733719] </TASK> <4> [117.733720] irq event stamp: 1867257 <4> [117.733721] hardirqs last enabled at (1867263): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.733723] hardirqs last disabled at (1867268): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.733725] softirqs last enabled at (1865528): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.733728] softirqs last disabled at (1865519): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.733730] ---[ end trace 0000000000000000 ]--- <5> [117.735226] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43315, lrc_seqno=43315, guc_id=0, flags=0x73 in no process [-1] <7> [117.735230] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [117.735236] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [117.735311] ------------[ cut here ]------------ <4> [117.735312] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.735313] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:8/1979 <4> [117.735397] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb <7> [117.735350] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [117.735402] mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.735468] CPU: 2 UID: 0 PID: 1979 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.735471] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.735472] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.735474] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.735480] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.735559] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.735561] RSP: 0018:ffffc90001a5fca0 EFLAGS: 00010246 <4> [117.735563] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.735565] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.735566] RBP: ffffc90001a5fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.735567] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.735568] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.735570] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [117.735571] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.735573] CR2: 00007ad8440643a8 CR3: 000000012c678004 CR4: 0000000000f72ef0 <4> [117.735574] PKRU: 55555554 <4> [117.735575] Call Trace: <4> [117.735576] <TASK> <4> [117.735580] ? lock_acquire+0x60/0x300 <4> [117.735585] ? lock_release+0xd0/0x2b0 <4> [117.735590] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.735596] process_one_work+0x239/0x740 <4> [117.735603] worker_thread+0x200/0x3f0 <4> [117.735606] ? __pfx_worker_thread+0x10/0x10 <4> [117.735609] kthread+0x10d/0x150 <4> [117.735611] ? __pfx_kthread+0x10/0x10 <4> [117.735614] ret_from_fork+0x3bd/0x470 <4> [117.735616] ? __pfx_kthread+0x10/0x10 <4> [117.735619] ret_from_fork_asm+0x1a/0x30 <4> [117.735626] </TASK> <4> [117.735627] irq event stamp: 293483 <4> [117.735628] hardirqs last enabled at (293489): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.735631] hardirqs last disabled at (293494): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.735632] softirqs last enabled at (291768): [<ffffffff8133ad53>] kernel_fpu_end+0x53/0x70 <4> [117.735635] softirqs last disabled at (291766): [<ffffffff8133b464>] kernel_fpu_begin_mask+0xc4/0x120 <4> [117.735637] ---[ end trace 0000000000000000 ]--- <6> [117.735639] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.735720] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.735727] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.735893] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.736135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.736239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.736343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.736438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.736528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.736616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.736702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.736790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.736887] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.736989] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.737083] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.738124] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.748845] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.749110] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.750152] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.750263] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.750349] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.750432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.750513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.750592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.750672] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.750750] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.750829] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.750937] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.751017] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.751095] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.751172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.751248] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.751324] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.751408] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.751484] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.751559] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.751635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.751722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.751808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.751902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.751982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.752065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.752148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.752226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.752304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.752382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.752459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.752539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.752619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.752698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.752777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.752864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.752948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.753034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.753118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.753205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.753287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.753366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.753444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.753521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.753596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.753674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.753754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.753831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.753925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.754003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.754080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.754157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.754239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.754318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.754397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.754474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.754551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.754629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.754706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.754782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.754865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.754943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.755020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.755097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.755173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.755249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.755326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.755402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.755477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.755554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.755636] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.755757] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.755762] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43315, lrc_seqno=43315, guc_id=0, flags=0x73 in no process [-1] <7> [117.755765] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.755833] ------------[ cut here ]------------ <4> [117.755839] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.755841] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:2/119 <4> [117.755920] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.755987] CPU: 11 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.755990] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.755992] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.755993] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.755999] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.756075] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.756077] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [117.756079] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.756081] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.756082] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.756083] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.756085] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.756086] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [117.756088] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.756089] CR2: 00007d0de2741560 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [117.756090] PKRU: 55555554 <4> [117.756092] Call Trace: <4> [117.756093] <TASK> <4> [117.756097] ? lock_acquire+0x60/0x300 <4> [117.756102] ? lock_release+0xd0/0x2b0 <4> [117.756107] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.756114] process_one_work+0x239/0x740 <4> [117.756120] worker_thread+0x200/0x3f0 <4> [117.756123] ? __pfx_worker_thread+0x10/0x10 <4> [117.756126] kthread+0x10d/0x150 <4> [117.756128] ? __pfx_kthread+0x10/0x10 <4> [117.756131] ret_from_fork+0x3bd/0x470 <4> [117.756133] ? __pfx_kthread+0x10/0x10 <4> [117.756136] ret_from_fork_asm+0x1a/0x30 <4> [117.756143] </TASK> <4> [117.756144] irq event stamp: 1731591 <4> [117.756146] hardirqs last enabled at (1731597): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.756148] hardirqs last disabled at (1731602): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.756150] softirqs last enabled at (1730426): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.756153] softirqs last disabled at (1730419): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.756155] ---[ end trace 0000000000000000 ]--- <6> [117.756892] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.757030] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.757042] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.757414] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [117.757526] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [117.757637] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.757860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.757958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.758055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.758146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.758235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.758322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.758409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.758497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.758580] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.758698] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.758793] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.759840] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.769843] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.770099] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.771135] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.771221] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.771306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.771388] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.771468] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.771547] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.771625] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.771703] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.771780] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.771866] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.771943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.772019] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.772096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.772172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.772249] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.772325] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.772400] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.772476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.772552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.772640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.772727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.772809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.772903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.772984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.773066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.773144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.773222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.773299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.773376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.773455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.773540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.773623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.773704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.773783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.773874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.773959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.774043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.774124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.774204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.774281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.774359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.774436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.774512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.774589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.774667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.774744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.774822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.774910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.774985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.775063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.775142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.775218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.775295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.775371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.775446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.775524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.775601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.775677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.775753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.775832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.775923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.776003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.776080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.776157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.776234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.776310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.776386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.776461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.776540] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.776660] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.776664] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43315, lrc_seqno=43315, guc_id=0, flags=0x73 in no process [-1] <7> [117.776667] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.776735] ------------[ cut here ]------------ <4> [117.776736] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.776738] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:5/202 <4> [117.776817] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.776888] CPU: 8 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.776891] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.776892] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.776893] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.776899] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.776975] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.776977] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.776979] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.776981] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.776982] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.776983] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.776984] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.776986] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [117.776987] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.776989] CR2: 00007372155ee008 CR3: 000000012c678006 CR4: 0000000000f72ef0 <4> [117.776990] PKRU: 55555554 <4> [117.776991] Call Trace: <4> [117.776992] <TASK> <4> [117.776996] ? lock_acquire+0x60/0x300 <4> [117.777001] ? lock_release+0xd0/0x2b0 <4> [117.777006] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.777012] process_one_work+0x239/0x740 <4> [117.777019] worker_thread+0x200/0x3f0 <4> [117.777022] ? __pfx_worker_thread+0x10/0x10 <4> [117.777025] kthread+0x10d/0x150 <4> [117.777027] ? __pfx_kthread+0x10/0x10 <4> [117.777030] ret_from_fork+0x3bd/0x470 <4> [117.777032] ? __pfx_kthread+0x10/0x10 <4> [117.777035] ret_from_fork_asm+0x1a/0x30 <4> [117.777043] </TASK> <4> [117.777044] irq event stamp: 1871603 <4> [117.777045] hardirqs last enabled at (1871609): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.777047] hardirqs last disabled at (1871614): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.777049] softirqs last enabled at (1870526): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.777052] softirqs last disabled at (1870519): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.777054] ---[ end trace 0000000000000000 ]--- <7> [117.778080] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [117.778197] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [117.778363] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43370, lrc_seqno=43370, guc_id=0, flags=0x73 in no process [-1] <7> [117.778368] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.778442] ------------[ cut here ]------------ <4> [117.778444] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.778445] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:2/119 <4> [117.778530] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.778596] CPU: 11 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.778599] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.778600] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.778601] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.778607] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.778686] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.778688] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [117.778690] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.778692] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.778693] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.778694] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.778696] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.778697] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [117.778699] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.778700] CR2: 00007d0de2741560 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [117.778701] PKRU: 55555554 <4> [117.778702] Call Trace: <4> [117.778704] <TASK> <4> [117.778707] ? lock_acquire+0x60/0x300 <4> [117.778712] ? lock_release+0xd0/0x2b0 <4> [117.778717] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.778723] process_one_work+0x239/0x740 <4> [117.778730] worker_thread+0x200/0x3f0 <4> [117.778733] ? __pfx_worker_thread+0x10/0x10 <4> [117.778735] kthread+0x10d/0x150 <4> [117.778738] ? __pfx_kthread+0x10/0x10 <4> [117.778741] ret_from_fork+0x3bd/0x470 <4> [117.778743] ? __pfx_kthread+0x10/0x10 <4> [117.778745] ret_from_fork_asm+0x1a/0x30 <4> [117.778753] </TASK> <4> [117.778754] irq event stamp: 1733437 <4> [117.778755] hardirqs last enabled at (1733443): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.778758] hardirqs last disabled at (1733448): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.778759] softirqs last enabled at (1732034): [<ffffffff8133ad53>] kernel_fpu_end+0x53/0x70 <4> [117.778762] softirqs last disabled at (1732032): [<ffffffff8133b464>] kernel_fpu_begin_mask+0xc4/0x120 <4> [117.778764] ---[ end trace 0000000000000000 ]--- <6> [117.778766] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.778851] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.778857] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.778918] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.779145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.779242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.779340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.779433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.779526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.779613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.779701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.779790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.779886] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.780007] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.780102] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.781149] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.791845] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.792105] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.793185] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.793300] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.793408] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.793518] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.793627] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.793738] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.793816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.793905] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.793996] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.794076] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.794156] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.794233] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.794311] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.794388] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.794465] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.794543] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.794620] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.794696] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.794773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.794869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.794957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.795040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.795118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.795198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.795278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.795355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.795433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.795509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.795586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.795665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.795745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.795823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.795918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.795997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.796082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.796166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.796249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.796329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.796409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.796486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.796564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.796639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.796715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.796791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.796882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.796961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.797039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.797115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.797192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.797269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.797348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.797424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.797500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.797576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.797652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.797727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.797804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.797890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.797968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.798047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.798125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.798203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.798278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.798353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.798430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.798507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.798582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.798656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.798735] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.799128] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.799133] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43370, lrc_seqno=43370, guc_id=0, flags=0x73 in no process [-1] <7> [117.799136] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.799209] ------------[ cut here ]------------ <4> [117.799210] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.799212] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:2/119 <4> [117.799295] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.799361] CPU: 11 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.799364] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.799365] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.799367] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.799373] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.799451] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.799453] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [117.799455] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.799456] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.799458] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.799459] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.799460] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.799462] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [117.799463] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.799465] CR2: 00007d0de2741560 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [117.799466] PKRU: 55555554 <4> [117.799467] Call Trace: <4> [117.799468] <TASK> <4> [117.799472] ? lock_acquire+0x60/0x300 <4> [117.799478] ? lock_release+0xd0/0x2b0 <4> [117.799483] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.799489] process_one_work+0x239/0x740 <4> [117.799495] worker_thread+0x200/0x3f0 <4> [117.799498] ? __pfx_worker_thread+0x10/0x10 <4> [117.799501] kthread+0x10d/0x150 <4> [117.799503] ? __pfx_kthread+0x10/0x10 <4> [117.799506] ret_from_fork+0x3bd/0x470 <4> [117.799508] ? __pfx_kthread+0x10/0x10 <4> [117.799511] ret_from_fork_asm+0x1a/0x30 <4> [117.799519] </TASK> <4> [117.799520] irq event stamp: 1736593 <4> [117.799521] hardirqs last enabled at (1736599): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.799523] hardirqs last disabled at (1736604): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.799525] softirqs last enabled at (1735596): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.799528] softirqs last disabled at (1735589): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.799530] ---[ end trace 0000000000000000 ]--- <6> [117.799532] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.799608] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.799614] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.800932] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [117.801045] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [117.801158] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.801379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.801482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.801583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.801681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.801774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.801873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.801962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.802051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.802134] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.802235] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.802328] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.803367] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.813843] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.814100] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.815095] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.815180] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.815261] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.815342] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.815423] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.815501] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.815578] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.815656] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.815733] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.815810] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.815896] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.815973] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.816047] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.816124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.816200] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.816276] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.816349] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.816424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.816499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.816586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.816671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.816750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.816827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.816927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.817006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.817082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.817158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.817234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.817309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.817387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.817466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.817544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.817621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.817698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.817782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.817873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.817958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.818038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.818117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.818195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.818272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.818349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.818424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.818502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.818581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.818658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.818735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.818811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.818903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.818981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.819062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.819139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.819217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.819294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.819370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.819447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.819524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.819598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.819673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.819751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.819826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.819915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.819991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.820066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.820143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.820219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.820294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.820367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.820444] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.820566] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.820570] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43370, lrc_seqno=43370, guc_id=0, flags=0x73 in no process [-1] <7> [117.820572] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.820640] ------------[ cut here ]------------ <4> [117.820641] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.820642] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:8/1979 <4> [117.820728] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.820795] CPU: 1 UID: 0 PID: 1979 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.820798] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.820799] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.820801] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.820806] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.820897] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.820900] RSP: 0018:ffffc90001a5fca0 EFLAGS: 00010246 <4> [117.820902] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.820904] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.820905] RBP: ffffc90001a5fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.820907] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.820908] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.820910] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [117.820911] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.820913] CR2: 00007ad854e8f000 CR3: 000000012c678003 CR4: 0000000000f72ef0 <4> [117.820914] PKRU: 55555554 <4> [117.820915] Call Trace: <4> [117.820916] <TASK> <4> [117.820920] ? lock_acquire+0x60/0x300 <4> [117.820926] ? lock_release+0xd0/0x2b0 <4> [117.820931] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.820937] process_one_work+0x239/0x740 <4> [117.820944] worker_thread+0x200/0x3f0 <4> [117.820947] ? __pfx_worker_thread+0x10/0x10 <4> [117.820950] kthread+0x10d/0x150 <4> [117.820953] ? __pfx_kthread+0x10/0x10 <4> [117.820956] ret_from_fork+0x3bd/0x470 <4> [117.820958] ? __pfx_kthread+0x10/0x10 <4> [117.820961] ret_from_fork_asm+0x1a/0x30 <4> [117.820969] </TASK> <4> [117.820970] irq event stamp: 298581 <4> [117.820971] hardirqs last enabled at (298587): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.820974] hardirqs last disabled at (298592): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.820975] softirqs last enabled at (298420): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.820978] softirqs last disabled at (298399): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.820981] ---[ end trace 0000000000000000 ]--- <5> [117.822556] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43425, lrc_seqno=43425, guc_id=0, flags=0x73 in no process [-1] <7> [117.822509] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [117.822562] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.822666] ------------[ cut here ]------------ <4> [117.822668] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [117.822620] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [117.822670] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:8/1979 <4> [117.822762] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.822829] CPU: 8 UID: 0 PID: 1979 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.822832] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.822833] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.822846] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.822853] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.822938] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.822940] RSP: 0018:ffffc90001a5fca0 EFLAGS: 00010246 <4> [117.822943] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.822944] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.822946] RBP: ffffc90001a5fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.822947] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.822948] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.822949] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [117.822951] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.822952] CR2: 00007372155ee008 CR3: 000000000344a001 CR4: 0000000000f72ef0 <4> [117.822954] PKRU: 55555554 <4> [117.822955] Call Trace: <4> [117.822956] <TASK> <4> [117.822960] ? lock_acquire+0x60/0x300 <4> [117.822966] ? lock_release+0xd0/0x2b0 <4> [117.822970] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.822976] process_one_work+0x239/0x740 <4> [117.822983] worker_thread+0x200/0x3f0 <4> [117.822987] ? __pfx_worker_thread+0x10/0x10 <4> [117.822989] kthread+0x10d/0x150 <4> [117.822992] ? __pfx_kthread+0x10/0x10 <4> [117.822994] ret_from_fork+0x3bd/0x470 <4> [117.822997] ? __pfx_kthread+0x10/0x10 <4> [117.822999] ret_from_fork_asm+0x1a/0x30 <4> [117.823007] </TASK> <4> [117.823008] irq event stamp: 300463 <4> [117.823009] hardirqs last enabled at (300469): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.823012] hardirqs last disabled at (300474): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.823013] softirqs last enabled at (300284): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.823016] softirqs last disabled at (300277): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.823019] ---[ end trace 0000000000000000 ]--- <6> [117.823021] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.823103] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.823111] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.823159] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.823377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.823481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.823586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.823683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.823776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.823875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.823966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.824058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.824146] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.824254] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.824355] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.825399] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.840843] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 14ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.841103] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.842112] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.842200] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.842283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.842364] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.842445] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.842523] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.842601] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.842681] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.842761] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.842847] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.842925] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.843002] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.843079] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.843156] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.843233] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.843310] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.843385] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.843460] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.843536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.843623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.843708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.843792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.843887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.843967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.844046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.844123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.844200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.844276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.844353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.844432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.844513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.844590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.844670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.844750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.844833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.844931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.845016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.845096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.845176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.845253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.845330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.845405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.845481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.845559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.845636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.845713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.845791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.845881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.845956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.846034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.846114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.846191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.846267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.846343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.846420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.846497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.846574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.846650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.846724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.846802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.846895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.846974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.847049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.847123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.847201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.847278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.847353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.847429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.847507] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.847626] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.847630] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43425, lrc_seqno=43425, guc_id=0, flags=0x73 in no process [-1] <7> [117.847632] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.847700] ------------[ cut here ]------------ <4> [117.847701] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.847703] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:8/1979 <4> [117.847789] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.847861] CPU: 1 UID: 0 PID: 1979 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.847864] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.847865] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.847866] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.847872] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.847946] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.847948] RSP: 0018:ffffc90001a5fca0 EFLAGS: 00010246 <4> [117.847951] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.847952] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.847953] RBP: ffffc90001a5fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.847954] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.847956] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.847957] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [117.847959] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.847960] CR2: 00007ad854e8f000 CR3: 000000012c678003 CR4: 0000000000f72ef0 <4> [117.847961] PKRU: 55555554 <4> [117.847963] Call Trace: <4> [117.847964] <TASK> <4> [117.847967] ? lock_acquire+0x60/0x300 <4> [117.847972] ? lock_release+0xd0/0x2b0 <4> [117.847977] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.847983] process_one_work+0x239/0x740 <4> [117.847990] worker_thread+0x200/0x3f0 <4> [117.847993] ? __pfx_worker_thread+0x10/0x10 <4> [117.847995] kthread+0x10d/0x150 <4> [117.847997] ? __pfx_kthread+0x10/0x10 <4> [117.848000] ret_from_fork+0x3bd/0x470 <4> [117.848003] ? __pfx_kthread+0x10/0x10 <4> [117.848005] ret_from_fork_asm+0x1a/0x30 <4> [117.848013] </TASK> <4> [117.848014] irq event stamp: 303671 <4> [117.848015] hardirqs last enabled at (303677): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.848017] hardirqs last disabled at (303682): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.848019] softirqs last enabled at (302780): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.848022] softirqs last disabled at (302759): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.848024] ---[ end trace 0000000000000000 ]--- <6> [117.848959] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.849040] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.849047] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.849061] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [117.849172] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [117.849281] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.849497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.849596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.849697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.849790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.849911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.849999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.850087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.850175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.850260] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.850361] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.850455] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.851490] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.861842] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.862096] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.863290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.863375] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.863455] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.863536] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.863616] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.863697] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.863776] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.863858] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.863936] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.864011] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.864088] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.864163] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.864241] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.864316] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.864392] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.864467] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.864542] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.864617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.864692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.864775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.864865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.864948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.865028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.865109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.865190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.865269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.865347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.865425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.865504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.865585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.865666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.865746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.865827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.865925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.866011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.866095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.866179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.866258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.866337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.866414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.866493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.866570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.866646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.866723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.866803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.866889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.866968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.867045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.867121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.867199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.867279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.867355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.867434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.867511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.867586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.867663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.867740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.867815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.867898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.867978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.868056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.868134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.868211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.868288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.868365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.868443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.868519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.868595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.868678] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.868799] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.868804] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43425, lrc_seqno=43425, guc_id=0, flags=0x73 in no process [-1] <7> [117.868806] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.868885] ------------[ cut here ]------------ <4> [117.868886] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.868888] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:5/202 <4> [117.868966] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.869032] CPU: 2 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.869035] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.869036] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.869038] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.869043] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.869120] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.869122] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.869124] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.869126] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.869127] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.869128] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.869129] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.869131] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [117.869132] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.869134] CR2: 00007ad8440643a8 CR3: 000000012c678004 CR4: 0000000000f72ef0 <4> [117.869135] PKRU: 55555554 <4> [117.869136] Call Trace: <4> [117.869137] <TASK> <4> [117.869142] ? lock_acquire+0x60/0x300 <4> [117.869147] ? lock_release+0xd0/0x2b0 <4> [117.869151] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.869157] process_one_work+0x239/0x740 <4> [117.869164] worker_thread+0x200/0x3f0 <4> [117.869167] ? __pfx_worker_thread+0x10/0x10 <4> [117.869170] kthread+0x10d/0x150 <4> [117.869172] ? __pfx_kthread+0x10/0x10 <4> [117.869175] ret_from_fork+0x3bd/0x470 <4> [117.869177] ? __pfx_kthread+0x10/0x10 <4> [117.869180] ret_from_fork_asm+0x1a/0x30 <4> [117.869187] </TASK> <4> [117.869189] irq event stamp: 1878297 <4> [117.869190] hardirqs last enabled at (1878303): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.869192] hardirqs last disabled at (1878308): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.869194] softirqs last enabled at (1877126): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.869197] softirqs last disabled at (1877121): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.869199] ---[ end trace 0000000000000000 ]--- <5> [117.869875] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43480, lrc_seqno=43480, guc_id=0, flags=0x73 in no process [-1] <7> [117.869885] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.870255] ------------[ cut here ]------------ <4> [117.870259] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.870261] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:5/202 <4> [117.870422] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.870509] CPU: 3 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.870513] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.870515] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.870518] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [117.870492] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [117.870526] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.870651] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.870654] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.870657] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.870660] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.870662] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.870664] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.870666] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.870668] FS: 0000000000000000(0000) GS:ffff8888dae03000(0000) knlGS:0000000000000000 <4> [117.870670] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.870672] CR2: 00007ad854e8c000 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [117.870675] PKRU: 55555554 <4> [117.870676] Call Trace: <4> [117.870678] <TASK> <4> [117.870684] ? lock_acquire+0x60/0x300 <4> [117.870691] ? lock_release+0xd0/0x2b0 <4> [117.870700] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.870710] process_one_work+0x239/0x740 <4> [117.870722] worker_thread+0x200/0x3f0 <7> [117.870654] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [117.870727] ? __pfx_worker_thread+0x10/0x10 <4> [117.870731] kthread+0x10d/0x150 <4> [117.870734] ? __pfx_kthread+0x10/0x10 <4> [117.870739] ret_from_fork+0x3bd/0x470 <4> [117.870742] ? __pfx_kthread+0x10/0x10 <4> [117.870746] ret_from_fork_asm+0x1a/0x30 <4> [117.870757] </TASK> <4> [117.870759] irq event stamp: 1880191 <4> [117.870760] hardirqs last enabled at (1880197): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.870763] hardirqs last disabled at (1880202): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.870765] softirqs last enabled at (1877126): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.870768] softirqs last disabled at (1877121): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.870772] ---[ end trace 0000000000000000 ]--- <6> [117.870774] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.870883] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.870892] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.871016] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.871287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.871398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.871500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.871594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.871686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.871775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.871881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.871973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.872060] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.872163] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.872257] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.873309] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.883845] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.884113] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.885249] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.885341] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.885425] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.885507] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.885586] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.885664] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.885741] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.885819] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.885918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.885996] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.886072] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.886148] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.886225] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.886301] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.886376] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.886452] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.886528] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.886604] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.886679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.886764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.886862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.886962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.887042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.887124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.887211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.887292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.887372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.887449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.887527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.887607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.887687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.887765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.887850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.887934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.888019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.888103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.888188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.888269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.888349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.888432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.888512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.888591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.888668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.888746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.888825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.888918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.888996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.889073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.889149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.889226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.889305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.889381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.889465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.889546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.889624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.889705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.889783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.889867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.889942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.890021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.890101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.890178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.890258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.890334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.890411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.890487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.890565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.890643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.890723] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.890849] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.890853] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43480, lrc_seqno=43480, guc_id=0, flags=0x73 in no process [-1] <7> [117.890856] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.890925] ------------[ cut here ]------------ <4> [117.890926] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.890927] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:2/119 <4> [117.891006] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.891073] CPU: 11 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.891076] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.891078] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.891079] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.891085] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.891161] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.891163] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [117.891165] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.891166] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.891168] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.891169] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.891170] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.891172] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [117.891173] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.891175] CR2: 00007d0de2741560 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [117.891176] PKRU: 55555554 <4> [117.891177] Call Trace: <4> [117.891178] <TASK> <4> [117.891182] ? lock_acquire+0x60/0x300 <4> [117.891188] ? lock_release+0xd0/0x2b0 <4> [117.891192] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.891198] process_one_work+0x239/0x740 <4> [117.891205] worker_thread+0x200/0x3f0 <4> [117.891208] ? __pfx_worker_thread+0x10/0x10 <4> [117.891211] kthread+0x10d/0x150 <4> [117.891213] ? __pfx_kthread+0x10/0x10 <4> [117.891216] ret_from_fork+0x3bd/0x470 <4> [117.891218] ? __pfx_kthread+0x10/0x10 <4> [117.891221] ret_from_fork_asm+0x1a/0x30 <4> [117.891228] </TASK> <4> [117.891230] irq event stamp: 1740917 <4> [117.891231] hardirqs last enabled at (1740923): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.891233] hardirqs last disabled at (1740928): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.891235] softirqs last enabled at (1739746): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.891237] softirqs last disabled at (1739737): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.891240] ---[ end trace 0000000000000000 ]--- <6> [117.891242] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.891322] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.891327] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.892649] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [117.892808] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [117.893215] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.893442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.893547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.893650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.893747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.893846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.893936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.894024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.894113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.894197] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.894298] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.894392] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.895426] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.906156] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.906413] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.907415] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.907499] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.907580] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.907661] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.907741] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.907820] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.907913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.907990] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.908068] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.908146] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.908223] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.908303] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.908382] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.908460] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.908537] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.908613] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.908689] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.908765] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.908844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.908930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.909013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.909093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.909171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.909252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.909331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.909410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.909486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.909563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.909640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.909719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.909799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.909888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.909968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.910046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.910130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.910214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.910297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.910379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.910458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.910537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.910614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.910689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.910766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.910845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.910925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.911002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.911080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.911156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.911233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.911311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.911391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.911468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.911544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.911624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.911704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.911785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.911870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.911946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.912022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.912101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.912176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.912254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.912331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.912405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.912483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.912560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.912635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.912709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.912786] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.912913] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.912918] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43480, lrc_seqno=43480, guc_id=0, flags=0x73 in no process [-1] <7> [117.912920] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.912988] ------------[ cut here ]------------ <4> [117.912989] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.912991] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:2/119 <4> [117.913069] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.913136] CPU: 6 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.913139] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.913140] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.913141] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.913148] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.913224] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.913225] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [117.913228] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.913229] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.913231] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.913232] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.913233] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.913234] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [117.913236] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.913237] CR2: 00007372155f3008 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [117.913239] PKRU: 55555554 <4> [117.913240] Call Trace: <4> [117.913241] <TASK> <4> [117.913245] ? lock_acquire+0x60/0x300 <4> [117.913251] ? lock_release+0xd0/0x2b0 <4> [117.913255] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.913262] process_one_work+0x239/0x740 <4> [117.913269] worker_thread+0x200/0x3f0 <4> [117.913272] ? __pfx_worker_thread+0x10/0x10 <4> [117.913274] kthread+0x10d/0x150 <4> [117.913277] ? __pfx_kthread+0x10/0x10 <4> [117.913280] ret_from_fork+0x3bd/0x470 <4> [117.913282] ? __pfx_kthread+0x10/0x10 <4> [117.913285] ret_from_fork_asm+0x1a/0x30 <4> [117.913293] </TASK> <4> [117.913294] irq event stamp: 1744097 <4> [117.913295] hardirqs last enabled at (1744103): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.913297] hardirqs last disabled at (1744108): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.913299] softirqs last enabled at (1743268): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.913302] softirqs last disabled at (1743261): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.913304] ---[ end trace 0000000000000000 ]--- <5> [117.914478] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43535, lrc_seqno=43535, guc_id=0, flags=0x73 in no process [-1] <7> [117.914481] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.914551] ------------[ cut here ]------------ <4> [117.914552] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.914553] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:2/119 <4> [117.914629] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.914693] CPU: 6 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.914696] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.914697] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.914698] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.914704] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.914777] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.914778] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [117.914781] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.914782] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.914783] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.914785] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.914786] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.914787] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [117.914789] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.914790] CR2: 00007372155f3008 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [117.914792] PKRU: 55555554 <4> [117.914793] Call Trace: <4> [117.914794] <TASK> <4> [117.914798] ? lock_acquire+0x60/0x300 <4> [117.914802] ? lock_release+0xd0/0x2b0 <4> [117.914807] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.914813] process_one_work+0x239/0x740 <4> [117.914819] worker_thread+0x200/0x3f0 <4> [117.914822] ? __pfx_worker_thread+0x10/0x10 <4> [117.914825] kthread+0x10d/0x150 <4> [117.914827] ? __pfx_kthread+0x10/0x10 <4> [117.914830] ret_from_fork+0x3bd/0x470 <4> [117.914833] ? __pfx_kthread+0x10/0x10 <4> [117.914840] ret_from_fork_asm+0x1a/0x30 <4> [117.914848] </TASK> <4> [117.914849] irq event stamp: 1745931 <4> [117.914850] hardirqs last enabled at (1745937): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.914852] hardirqs last disabled at (1745942): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.914854] softirqs last enabled at (1743268): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.914857] softirqs last disabled at (1743261): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.914860] ---[ end trace 0000000000000000 ]--- <6> [117.914862] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.914937] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.914945] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.915135] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [117.915244] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [117.915536] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.915755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.915858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.915956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.916048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.916143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.916232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.916320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.916408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.916492] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.916592] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.916686] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.917721] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.927842] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.928100] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.929178] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.929263] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.929343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.929422] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.929501] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.929582] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.929659] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.929736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.929813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.929900] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.929977] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.930052] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.930127] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.930202] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.930277] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.930353] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.930427] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.930500] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.930573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.930658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.930743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.930824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.930915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.930999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.931080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.931158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.931235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.931311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.931388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.931465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.931544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.931621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.931699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.931778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.931864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.931949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.932033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.932114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.932195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.932272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.932351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.932428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.932504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.932582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.932662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.932739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.932817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.932905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.932981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.933059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.933139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.933215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.933292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.933366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.933442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.933519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.933596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.933670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.933744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.933822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.933913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.933996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.934073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.934149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.934226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.934304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.934384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.934459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.934538] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.934657] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.934661] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43535, lrc_seqno=43535, guc_id=0, flags=0x73 in no process [-1] <7> [117.934663] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.934731] ------------[ cut here ]------------ <4> [117.934732] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.934733] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:2/119 <4> [117.934811] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.934881] CPU: 6 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.934884] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.934885] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.934886] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.934892] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.934968] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.934970] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [117.934972] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.934974] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.934975] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.934976] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.934977] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.934979] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [117.934980] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.934982] CR2: 00007372155f3008 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [117.934983] PKRU: 55555554 <4> [117.934984] Call Trace: <4> [117.934985] <TASK> <4> [117.934989] ? lock_acquire+0x60/0x300 <4> [117.934994] ? lock_release+0xd0/0x2b0 <4> [117.934999] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.935005] process_one_work+0x239/0x740 <4> [117.935012] worker_thread+0x200/0x3f0 <4> [117.935015] ? __pfx_worker_thread+0x10/0x10 <4> [117.935017] kthread+0x10d/0x150 <4> [117.935020] ? __pfx_kthread+0x10/0x10 <4> [117.935023] ret_from_fork+0x3bd/0x470 <4> [117.935025] ? __pfx_kthread+0x10/0x10 <4> [117.935027] ret_from_fork_asm+0x1a/0x30 <4> [117.935035] </TASK> <4> [117.935036] irq event stamp: 1749087 <4> [117.935037] hardirqs last enabled at (1749093): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.935040] hardirqs last disabled at (1749098): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.935041] softirqs last enabled at (1748198): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.935044] softirqs last disabled at (1748191): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.935046] ---[ end trace 0000000000000000 ]--- <6> [117.935844] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.935986] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.935996] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.936065] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [117.936175] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [117.936286] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.936853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.936965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.937068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.937161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.937249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.937336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.937422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.937510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.937593] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.937694] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.937787] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.938833] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.948844] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.949103] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.950135] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.950221] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.950302] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.950384] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.950464] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.950545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.950626] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.950704] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.950779] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.950870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.950946] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.951022] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.951096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.951171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.951247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.951323] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.951399] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.951473] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.951548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.951634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.951718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.951799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.951888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.951970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.952051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.952129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.952206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.952284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.952362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.952442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.952523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.952601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.952681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.952761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.952849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.952935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.953019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.953100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.953181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.953259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.953338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.953414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.953490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.953569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.953647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.953725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.953803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.953903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.953980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.954058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.954139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.954215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.954292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.954373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.954448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.954525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.954600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.954692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.954770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.954854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.954931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.955010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.955091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.955168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.955247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.955325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.955401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.955477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.955557] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.955854] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.955859] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43535, lrc_seqno=43535, guc_id=0, flags=0x73 in no process [-1] <7> [117.955862] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.955931] ------------[ cut here ]------------ <4> [117.955932] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.955933] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:5/202 <4> [117.956012] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.956079] CPU: 8 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.956082] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.956084] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.956085] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.956091] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.956168] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.956169] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.956172] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.956173] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.956175] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.956176] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.956177] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.956178] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [117.956180] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.956181] CR2: 00007372155ee008 CR3: 000000012c678006 CR4: 0000000000f72ef0 <4> [117.956183] PKRU: 55555554 <4> [117.956184] Call Trace: <4> [117.956185] <TASK> <4> [117.956189] ? lock_acquire+0x60/0x300 <4> [117.956195] ? lock_release+0xd0/0x2b0 <4> [117.956200] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.956206] process_one_work+0x239/0x740 <4> [117.956213] worker_thread+0x200/0x3f0 <4> [117.956216] ? __pfx_worker_thread+0x10/0x10 <4> [117.956218] kthread+0x10d/0x150 <4> [117.956221] ? __pfx_kthread+0x10/0x10 <4> [117.956224] ret_from_fork+0x3bd/0x470 <4> [117.956226] ? __pfx_kthread+0x10/0x10 <4> [117.956228] ret_from_fork_asm+0x1a/0x30 <4> [117.956236] </TASK> <4> [117.956237] irq event stamp: 1886697 <4> [117.956238] hardirqs last enabled at (1886703): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.956241] hardirqs last disabled at (1886708): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.956242] softirqs last enabled at (1885800): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.956245] softirqs last disabled at (1885793): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.956248] ---[ end trace 0000000000000000 ]--- <5> [117.957261] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43590, lrc_seqno=43590, guc_id=0, flags=0x73 in no process [-1] <7> [117.957268] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.957389] ------------[ cut here ]------------ <4> [117.957391] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.957393] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:5/202 <4> [117.957480] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.957549] CPU: 3 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.957552] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.957553] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.957554] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <7> [117.957509] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [117.957561] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.957642] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.957644] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.957646] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.957648] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.957649] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.957650] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.957652] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.957653] FS: 0000000000000000(0000) GS:ffff8888dae03000(0000) knlGS:0000000000000000 <4> [117.957655] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.957656] CR2: 00007ad854e8c000 CR3: 000000011d065003 CR4: 0000000000f72ef0 <4> [117.957657] PKRU: 55555554 <4> [117.957659] Call Trace: <4> [117.957660] <TASK> <4> [117.957664] ? lock_acquire+0x60/0x300 <4> [117.957669] ? lock_release+0xd0/0x2b0 <7> [117.957624] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [117.957674] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.957680] process_one_work+0x239/0x740 <4> [117.957686] worker_thread+0x200/0x3f0 <4> [117.957689] ? __pfx_worker_thread+0x10/0x10 <4> [117.957691] kthread+0x10d/0x150 <4> [117.957693] ? __pfx_kthread+0x10/0x10 <4> [117.957696] ret_from_fork+0x3bd/0x470 <4> [117.957698] ? __pfx_kthread+0x10/0x10 <4> [117.957701] ret_from_fork_asm+0x1a/0x30 <4> [117.957708] </TASK> <4> [117.957709] irq event stamp: 1888575 <4> [117.957710] hardirqs last enabled at (1888581): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.957712] hardirqs last disabled at (1888586): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.957714] softirqs last enabled at (1885800): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.957716] softirqs last disabled at (1885793): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.957718] ---[ end trace 0000000000000000 ]--- <6> [117.957720] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.957798] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.957805] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.957903] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.958116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.958213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.958311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.958404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.958495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.958584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.958671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.958761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.958851] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.958953] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.959048] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.960084] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.969843] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.970101] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.971136] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.971222] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.971302] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.971384] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.971463] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.971542] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.971619] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.971697] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.971775] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.971856] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.971933] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.972011] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.972090] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.972167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.972244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.972320] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.972396] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.972472] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.972547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.972632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.972717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.972798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.972888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.972969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.973049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.973127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.973205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.973284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.973364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.973443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.973524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.973603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.973683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.973762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.973850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.973932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.974016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.974097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.974176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.974253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.974330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.974407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.974483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.974561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.974639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.974719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.974797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.974882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.974959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.975037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.975116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.975192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.975268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.975344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.975420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.975499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.975581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.975659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.975736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.975816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.975902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.975980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.976057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.976134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.976212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.976290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.976366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.976443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.976523] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.976643] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.976648] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43590, lrc_seqno=43590, guc_id=0, flags=0x73 in no process [-1] <7> [117.976650] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.976717] ------------[ cut here ]------------ <4> [117.976719] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.976720] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#3: kworker/u64:5/202 <4> [117.976797] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.976868] CPU: 3 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.976870] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.976872] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.976873] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.976879] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.976955] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.976956] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [117.976959] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.976960] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.976961] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.976963] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.976964] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.976965] FS: 0000000000000000(0000) GS:ffff8888dae03000(0000) knlGS:0000000000000000 <4> [117.976967] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.976968] CR2: 00007ad854e8c000 CR3: 000000011d065003 CR4: 0000000000f72ef0 <4> [117.976970] PKRU: 55555554 <4> [117.976971] Call Trace: <4> [117.976972] <TASK> <4> [117.976976] ? lock_acquire+0x60/0x300 <4> [117.976981] ? lock_release+0xd0/0x2b0 <4> [117.976986] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.976992] process_one_work+0x239/0x740 <4> [117.976999] worker_thread+0x200/0x3f0 <4> [117.977002] ? __pfx_worker_thread+0x10/0x10 <4> [117.977004] kthread+0x10d/0x150 <4> [117.977007] ? __pfx_kthread+0x10/0x10 <4> [117.977010] ret_from_fork+0x3bd/0x470 <4> [117.977012] ? __pfx_kthread+0x10/0x10 <4> [117.977015] ret_from_fork_asm+0x1a/0x30 <4> [117.977022] </TASK> <4> [117.977023] irq event stamp: 1891739 <4> [117.977024] hardirqs last enabled at (1891745): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.977027] hardirqs last disabled at (1891750): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.977028] softirqs last enabled at (1890580): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.977031] softirqs last disabled at (1890571): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.977034] ---[ end trace 0000000000000000 ]--- <6> [117.977036] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [117.977110] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [117.977117] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [117.978359] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [117.978473] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [117.978591] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [117.978878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [117.978987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [117.979090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [117.979183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [117.979275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [117.979363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [117.979452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [117.979542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [117.979630] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [117.979733] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [117.979827] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [117.980887] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [117.990843] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [117.991103] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [117.992081] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [117.992167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [117.992249] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [117.992331] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [117.992410] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [117.992489] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [117.992565] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [117.992640] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [117.992716] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [117.992790] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [117.992885] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [117.992960] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [117.993036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [117.993110] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [117.993186] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [117.993261] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [117.993337] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [117.993412] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [117.993488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [117.993575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [117.993659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [117.993741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [117.993822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [117.993917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [117.994002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [117.994080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [117.994158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [117.994236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [117.994313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [117.994394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [117.994474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [117.994553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [117.994633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [117.994712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [117.994795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [117.994889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [117.994974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [117.995055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [117.995134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [117.995211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [117.995288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [117.995366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [117.995443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [117.995521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [117.995600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [117.995676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [117.995754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [117.995832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [117.995922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [117.996005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [117.996087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [117.996165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [117.996244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [117.996320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [117.996395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [117.996472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [117.996548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [117.996622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [117.996698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [117.996777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [117.996867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [117.996944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [117.997021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [117.997095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [117.997172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [117.997248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [117.997322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [117.997396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [117.997474] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [117.997595] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [117.997600] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43590, lrc_seqno=43590, guc_id=0, flags=0x73 in no process [-1] <7> [117.997603] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [117.997672] ------------[ cut here ]------------ <4> [117.997673] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [117.997674] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:2/119 <4> [117.997765] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.997833] CPU: 10 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.997840] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.997841] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.997842] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.997848] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.997925] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.997927] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [117.997929] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.997931] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.997932] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.997933] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.997934] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [117.997936] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [117.997937] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [117.997939] CR2: 00007d0de11e62f4 CR3: 000000011d065005 CR4: 0000000000f72ef0 <4> [117.997940] PKRU: 55555554 <4> [117.997941] Call Trace: <4> [117.997943] <TASK> <4> [117.997946] ? lock_acquire+0x60/0x300 <4> [117.997952] ? lock_release+0xd0/0x2b0 <4> [117.997957] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [117.997963] process_one_work+0x239/0x740 <4> [117.997970] worker_thread+0x200/0x3f0 <4> [117.997973] ? __pfx_worker_thread+0x10/0x10 <4> [117.997976] kthread+0x10d/0x150 <4> [117.997978] ? __pfx_kthread+0x10/0x10 <4> [117.997981] ret_from_fork+0x3bd/0x470 <4> [117.997983] ? __pfx_kthread+0x10/0x10 <4> [117.997986] ret_from_fork_asm+0x1a/0x30 <4> [117.997994] </TASK> <4> [117.997995] irq event stamp: 1752855 <4> [117.997996] hardirqs last enabled at (1752861): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [117.997998] hardirqs last disabled at (1752866): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [117.998000] softirqs last enabled at (1751964): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.998003] softirqs last disabled at (1751883): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [117.998005] ---[ end trace 0000000000000000 ]--- <5> [117.999538] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43645, lrc_seqno=43645, guc_id=0, flags=0x73 in no process [-1] <7> [117.999545] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [117.999545] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [117.999654] ------------[ cut here ]------------ <4> [117.999656] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <7> [117.999659] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [117.999659] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:8/1979 <4> [117.999780] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [117.999894] CPU: 1 UID: 0 PID: 1979 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [117.999897] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [117.999898] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [117.999900] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [117.999906] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [117.999989] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [117.999991] RSP: 0018:ffffc90001a5fca0 EFLAGS: 00010246 <4> [117.999993] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [117.999994] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [117.999996] RBP: ffffc90001a5fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [117.999997] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [117.999998] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.000000] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [118.000001] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.000003] CR2: 00007ad854e91000 CR3: 000000012c678003 CR4: 0000000000f72ef0 <4> [118.000004] PKRU: 55555554 <4> [118.000006] Call Trace: <4> [118.000007] <TASK> <4> [118.000011] ? lock_acquire+0x60/0x300 <4> [118.000016] ? lock_release+0xd0/0x2b0 <4> [118.000021] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.000027] process_one_work+0x239/0x740 <4> [118.000033] worker_thread+0x200/0x3f0 <4> [118.000036] ? __pfx_worker_thread+0x10/0x10 <4> [118.000039] kthread+0x10d/0x150 <4> [118.000041] ? __pfx_kthread+0x10/0x10 <4> [118.000044] ret_from_fork+0x3bd/0x470 <4> [118.000047] ? __pfx_kthread+0x10/0x10 <4> [118.000049] ret_from_fork_asm+0x1a/0x30 <4> [118.000057] </TASK> <4> [118.000058] irq event stamp: 307565 <4> [118.000060] hardirqs last enabled at (307571): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.000062] hardirqs last disabled at (307576): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.000064] softirqs last enabled at (307064): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.000067] softirqs last disabled at (307057): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.000069] ---[ end trace 0000000000000000 ]--- <6> [118.000072] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [118.000151] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [118.000161] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [118.000390] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [118.000605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [118.000703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [118.000801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [118.000909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [118.001000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [118.001087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [118.001177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [118.001267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [118.001352] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [118.001453] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [118.001548] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [118.002586] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [118.012844] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [118.013109] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [118.014170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [118.014256] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [118.014332] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [118.014409] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [118.014482] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [118.014555] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [118.014626] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [118.014697] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [118.014768] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [118.014847] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [118.014923] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [118.015000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [118.015076] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [118.015153] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [118.015230] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [118.015307] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [118.015382] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [118.015458] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [118.015533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [118.015619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [118.015704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [118.015786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [118.015876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [118.015958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [118.016038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [118.016116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [118.016193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [118.016271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [118.016348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [118.016428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [118.016507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [118.016585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [118.016665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [118.016743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [118.016829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [118.016929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [118.017016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [118.017102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [118.017184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [118.017262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [118.017339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [118.017416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [118.017493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [118.017571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [118.017650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [118.017725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [118.017803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [118.017891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [118.017966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [118.018046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [118.018125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [118.018201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [118.018278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [118.018354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [118.018429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [118.018506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [118.018582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [118.018657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [118.018732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [118.018808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [118.018895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [118.018972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [118.019050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [118.019127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [118.019202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [118.019277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [118.019350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [118.019426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [118.019503] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [118.019629] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [118.019633] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43645, lrc_seqno=43645, guc_id=0, flags=0x73 in no process [-1] <7> [118.019636] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.019704] ------------[ cut here ]------------ <4> [118.019705] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.019707] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:2/119 <4> [118.019794] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.020110] CPU: 2 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.020114] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.020115] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.020116] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.020123] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.020201] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.020202] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [118.020205] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.020207] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.020208] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.020210] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.020211] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.020213] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [118.020215] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.020216] CR2: 00007ad8440643a8 CR3: 000000000344a002 CR4: 0000000000f72ef0 <4> [118.020218] PKRU: 55555554 <4> [118.020219] Call Trace: <4> [118.020221] <TASK> <4> [118.020225] ? lock_acquire+0x60/0x300 <4> [118.020230] ? lock_release+0xd0/0x2b0 <4> [118.020236] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.020242] process_one_work+0x239/0x740 <4> [118.020249] worker_thread+0x200/0x3f0 <4> [118.020252] ? __pfx_worker_thread+0x10/0x10 <4> [118.020255] kthread+0x10d/0x150 <4> [118.020258] ? __pfx_kthread+0x10/0x10 <4> [118.020261] ret_from_fork+0x3bd/0x470 <4> [118.020263] ? __pfx_kthread+0x10/0x10 <4> [118.020266] ret_from_fork_asm+0x1a/0x30 <4> [118.020274] </TASK> <4> [118.020276] irq event stamp: 1757145 <4> [118.020277] hardirqs last enabled at (1757151): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.020279] hardirqs last disabled at (1757156): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.020281] softirqs last enabled at (1755882): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.020285] softirqs last disabled at (1755873): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.020287] ---[ end trace 0000000000000000 ]--- <6> [118.020901] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [118.021099] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [118.021115] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [118.021540] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [118.021653] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [118.021763] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [118.021986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [118.022083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [118.022181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [118.022273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [118.022362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [118.022450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [118.022539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [118.022629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [118.022714] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [118.022816] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [118.022925] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [118.023963] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [118.033846] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [118.034102] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [118.035093] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [118.035179] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [118.035260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [118.035342] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [118.035422] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [118.035501] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [118.035577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [118.035655] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [118.035733] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [118.035810] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [118.035896] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [118.035972] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [118.036048] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [118.036122] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [118.036197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [118.036273] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [118.036348] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [118.036421] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [118.036496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [118.036582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [118.036666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [118.036749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [118.036829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [118.036930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [118.037011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [118.037090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [118.037167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [118.037245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [118.037323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [118.037402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [118.037483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [118.037563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [118.037644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [118.037724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [118.037808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [118.037910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [118.037995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [118.038076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [118.038158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [118.038236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [118.038319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [118.038400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [118.038479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [118.038557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [118.038635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [118.038713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [118.038795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [118.038887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [118.038964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [118.039041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [118.039121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [118.039199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [118.039277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [118.039353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [118.039429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [118.039505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [118.039583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [118.039658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [118.039734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [118.039812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [118.039905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [118.039984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [118.040061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [118.040137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [118.040213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [118.040290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [118.040364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [118.040438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [118.040519] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [118.040640] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [118.040644] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43645, lrc_seqno=43645, guc_id=0, flags=0x73 in no process [-1] <7> [118.040646] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.040881] ------------[ cut here ]------------ <4> [118.040886] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.040892] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#0: kworker/u64:8/1979 <4> [118.041270] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.041412] CPU: 0 UID: 0 PID: 1979 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.041420] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.041422] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.041425] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.041442] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.041621] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.041623] RSP: 0018:ffffc90001a5fca0 EFLAGS: 00010246 <4> [118.041626] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.041627] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.041629] RBP: ffffc90001a5fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.041630] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.041631] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.041633] FS: 0000000000000000(0000) GS:ffff8888dac83000(0000) knlGS:0000000000000000 <4> [118.041634] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.041636] CR2: 00007ffd1bba7f58 CR3: 000000000344a002 CR4: 0000000000f72ef0 <4> [118.041637] PKRU: 55555554 <4> [118.041638] Call Trace: <4> [118.041639] <TASK> <4> [118.041644] ? lock_acquire+0x60/0x300 <4> [118.041649] ? lock_release+0xd0/0x2b0 <4> [118.041654] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.041664] process_one_work+0x239/0x740 <4> [118.041676] worker_thread+0x200/0x3f0 <4> [118.041681] ? __pfx_worker_thread+0x10/0x10 <4> [118.041686] kthread+0x10d/0x150 <4> [118.041689] ? __pfx_kthread+0x10/0x10 <4> [118.041694] ret_from_fork+0x3bd/0x470 <4> [118.041697] ? __pfx_kthread+0x10/0x10 <4> [118.041701] ret_from_fork_asm+0x1a/0x30 <4> [118.041713] </TASK> <4> [118.041714] irq event stamp: 311937 <4> [118.041716] hardirqs last enabled at (311943): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.041720] hardirqs last disabled at (311948): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.041722] softirqs last enabled at (310958): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.041727] softirqs last disabled at (310951): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.041730] ---[ end trace 0000000000000000 ]--- <7> [118.041679] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [118.041842] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [118.042264] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43700, lrc_seqno=43700, guc_id=0, flags=0x73 in no process [-1] <7> [118.042269] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.042347] ------------[ cut here ]------------ <4> [118.042348] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.042350] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:8/1979 <4> [118.042436] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.042504] CPU: 10 UID: 0 PID: 1979 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.042507] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.042508] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.042509] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.042515] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.042595] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.042597] RSP: 0018:ffffc90001a5fca0 EFLAGS: 00010246 <4> [118.042600] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.042601] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.042603] RBP: ffffc90001a5fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.042604] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.042605] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.042606] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [118.042608] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.042609] CR2: 00007d0de11e62f4 CR3: 000000012c678001 CR4: 0000000000f72ef0 <4> [118.042611] PKRU: 55555554 <4> [118.042612] Call Trace: <4> [118.042613] <TASK> <4> [118.042617] ? lock_acquire+0x60/0x300 <4> [118.042622] ? lock_release+0xd0/0x2b0 <4> [118.042627] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.042633] process_one_work+0x239/0x740 <4> [118.042640] worker_thread+0x200/0x3f0 <4> [118.042643] ? __pfx_worker_thread+0x10/0x10 <4> [118.042646] kthread+0x10d/0x150 <4> [118.042648] ? __pfx_kthread+0x10/0x10 <4> [118.042651] ret_from_fork+0x3bd/0x470 <4> [118.042653] ? __pfx_kthread+0x10/0x10 <4> [118.042656] ret_from_fork_asm+0x1a/0x30 <4> [118.042663] </TASK> <4> [118.042665] irq event stamp: 314203 <4> [118.042666] hardirqs last enabled at (314209): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.042668] hardirqs last disabled at (314214): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.042670] softirqs last enabled at (312054): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.042672] softirqs last disabled at (312047): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.042675] ---[ end trace 0000000000000000 ]--- <6> [118.042677] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [118.042755] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [118.042763] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [118.042851] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [118.043128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [118.043226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [118.043326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [118.043418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [118.043508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [118.043597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [118.043685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [118.043773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [118.043865] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [118.043966] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [118.044063] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [118.045100] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [118.054851] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [118.055113] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [118.056108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [118.056194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [118.056271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [118.056347] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [118.056423] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [118.056496] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [118.056567] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [118.056638] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [118.056709] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [118.056779] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [118.056853] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [118.056931] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [118.057000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [118.057069] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [118.057138] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [118.057208] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [118.057277] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [118.057347] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [118.057416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [118.057496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [118.057573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [118.057647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [118.057718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [118.057792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [118.057875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [118.057953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [118.058023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [118.058092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [118.058161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [118.058233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [118.058306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [118.058378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [118.058449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [118.058522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [118.058599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [118.058676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [118.058751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [118.058824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [118.058915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [118.058986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [118.059057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [118.059131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [118.059199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [118.059273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [118.059343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [118.059413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [118.059483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [118.059552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [118.059619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [118.059690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [118.059760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [118.059832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [118.059919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [118.059989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [118.060057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [118.060126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [118.060196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [118.060268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [118.060335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [118.060406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [118.060475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [118.060544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [118.060612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [118.060681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [118.060751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [118.060821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [118.060897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [118.060965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [118.061037] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [118.061149] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [118.061153] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43700, lrc_seqno=43700, guc_id=0, flags=0x73 in no process [-1] <7> [118.061156] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.061225] ------------[ cut here ]------------ <4> [118.061226] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.061227] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:2/119 <4> [118.061299] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.061360] CPU: 1 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.061363] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.061364] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.061365] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.061370] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.061440] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.061442] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [118.061444] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.061445] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.061447] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.061448] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.061449] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.061450] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [118.061451] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.061453] CR2: 00007ad854e91000 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [118.061454] PKRU: 55555554 <4> [118.061455] Call Trace: <4> [118.061456] <TASK> <4> [118.061460] ? lock_acquire+0x60/0x300 <4> [118.061464] ? lock_release+0xd0/0x2b0 <4> [118.061469] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.061474] process_one_work+0x239/0x740 <4> [118.061481] worker_thread+0x200/0x3f0 <4> [118.061483] ? __pfx_worker_thread+0x10/0x10 <4> [118.061486] kthread+0x10d/0x150 <4> [118.061488] ? __pfx_kthread+0x10/0x10 <4> [118.061490] ret_from_fork+0x3bd/0x470 <4> [118.061492] ? __pfx_kthread+0x10/0x10 <4> [118.061495] ret_from_fork_asm+0x1a/0x30 <4> [118.061502] </TASK> <4> [118.061503] irq event stamp: 1761505 <4> [118.061504] hardirqs last enabled at (1761511): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.061506] hardirqs last disabled at (1761516): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.061508] softirqs last enabled at (1760566): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.061510] softirqs last disabled at (1760559): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.061512] ---[ end trace 0000000000000000 ]--- <6> [118.061514] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [118.061584] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [118.061589] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [118.062922] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [118.063030] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [118.063289] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [118.063497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [118.063584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [118.063673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [118.063757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [118.063844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [118.063933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [118.064014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [118.064097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [118.064175] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [118.064268] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [118.064354] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [118.065374] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [118.076099] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [118.076350] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [118.077406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [118.077485] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [118.077559] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [118.077633] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [118.077704] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [118.077774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [118.077850] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [118.077927] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [118.078002] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [118.078077] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [118.078153] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [118.078230] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [118.078306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [118.078382] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [118.078458] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [118.078533] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [118.078609] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [118.078683] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [118.078758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [118.078850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [118.078937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [118.079017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [118.079096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [118.079177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [118.079257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [118.079338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [118.079416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [118.079493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [118.079570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [118.079648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [118.079727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [118.079807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [118.079900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [118.079979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [118.080064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [118.080149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [118.080233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [118.080313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [118.080391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [118.080468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [118.080545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [118.080621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [118.080698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [118.080776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [118.080865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [118.080943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [118.081021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [118.081102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [118.081181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [118.081260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [118.081340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [118.081417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [118.081496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [118.081573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [118.081648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [118.081724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [118.081801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [118.081886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [118.081962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [118.082040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [118.082117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [118.082194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [118.082270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [118.082346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [118.082423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [118.082499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [118.082575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [118.082648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [118.082727] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [118.082852] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [118.082856] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43700, lrc_seqno=43700, guc_id=0, flags=0x73 in no process [-1] <7> [118.082859] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.082926] ------------[ cut here ]------------ <4> [118.082927] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.082929] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:2/119 <4> [118.083007] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.083073] CPU: 1 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.083076] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.083078] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.083079] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.083085] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.083161] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.083163] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [118.083165] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.083166] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.083168] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.083169] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.083170] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.083172] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [118.083173] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.083175] CR2: 00007ad854e91000 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [118.083176] PKRU: 55555554 <4> [118.083177] Call Trace: <4> [118.083178] <TASK> <4> [118.083182] ? lock_acquire+0x60/0x300 <4> [118.083188] ? lock_release+0xd0/0x2b0 <4> [118.083192] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.083199] process_one_work+0x239/0x740 <4> [118.083205] worker_thread+0x200/0x3f0 <4> [118.083208] ? __pfx_worker_thread+0x10/0x10 <4> [118.083211] kthread+0x10d/0x150 <4> [118.083213] ? __pfx_kthread+0x10/0x10 <4> [118.083216] ret_from_fork+0x3bd/0x470 <4> [118.083218] ? __pfx_kthread+0x10/0x10 <4> [118.083221] ret_from_fork_asm+0x1a/0x30 <4> [118.083229] </TASK> <4> [118.083230] irq event stamp: 1764693 <4> [118.083231] hardirqs last enabled at (1764699): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.083233] hardirqs last disabled at (1764704): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.083235] softirqs last enabled at (1763902): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.083238] softirqs last disabled at (1763895): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.083240] ---[ end trace 0000000000000000 ]--- <5> [118.084605] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43755, lrc_seqno=43755, guc_id=0, flags=0x73 in no process [-1] <7> [118.084608] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.084863] ------------[ cut here ]------------ <4> [118.084864] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.084865] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:2/119 <4> [118.084943] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.085009] CPU: 1 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.085012] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.085013] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.085014] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.085020] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.085094] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.085095] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [118.085097] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.085099] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.085100] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.085101] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.085102] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.085104] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [118.085105] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.085107] CR2: 00007ad854e91000 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [118.085108] PKRU: 55555554 <4> [118.085109] Call Trace: <4> [118.085110] <TASK> <4> [118.085114] ? lock_acquire+0x60/0x300 <4> [118.085119] ? lock_release+0xd0/0x2b0 <4> [118.085123] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.085129] process_one_work+0x239/0x740 <4> [118.085135] worker_thread+0x200/0x3f0 <4> [118.085139] ? __pfx_worker_thread+0x10/0x10 <4> [118.085141] kthread+0x10d/0x150 <4> [118.085144] ? __pfx_kthread+0x10/0x10 <4> [118.085147] ret_from_fork+0x3bd/0x470 <4> [118.085149] ? __pfx_kthread+0x10/0x10 <4> [118.085152] ret_from_fork_asm+0x1a/0x30 <4> [118.085159] </TASK> <4> [118.085160] irq event stamp: 1766583 <4> [118.085161] hardirqs last enabled at (1766589): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.085164] hardirqs last disabled at (1766594): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.085165] softirqs last enabled at (1763902): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.085168] softirqs last disabled at (1763895): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.085171] ---[ end trace 0000000000000000 ]--- <6> [118.085172] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [118.085248] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [118.085254] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [118.085310] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [118.085420] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [118.085531] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [118.085743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [118.085842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [118.085942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [118.086034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [118.086123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [118.086210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [118.086298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [118.086387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [118.086472] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [118.086571] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [118.086663] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [118.087700] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [118.097846] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [118.098104] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [118.099125] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [118.099211] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [118.099292] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [118.099373] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [118.099458] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [118.099539] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [118.099619] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [118.099697] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [118.099774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [118.099861] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [118.099940] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [118.100016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [118.100092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [118.100169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [118.100245] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [118.100318] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [118.100393] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [118.100468] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [118.100543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [118.100627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [118.100709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [118.100791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [118.100886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [118.100967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [118.101048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [118.101125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [118.101201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [118.101277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [118.101353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [118.101432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [118.101512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [118.101590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [118.101669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [118.101750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [118.101841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [118.101926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [118.102011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [118.102091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [118.102172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [118.102249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [118.102327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [118.102403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [118.102478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [118.102556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [118.102635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [118.102713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [118.102791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [118.102881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [118.102976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [118.103056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [118.103137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [118.103215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [118.103292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [118.103368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [118.103445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [118.103527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [118.103605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [118.103682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [118.103759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [118.103849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [118.103926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [118.104003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [118.104084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [118.104159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [118.104237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [118.104314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [118.104390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [118.104465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [118.104544] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [118.104664] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [118.104668] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43755, lrc_seqno=43755, guc_id=0, flags=0x73 in no process [-1] <7> [118.104670] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.104738] ------------[ cut here ]------------ <4> [118.104739] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.104740] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:2/119 <4> [118.104818] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.104895] CPU: 1 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.104898] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.104899] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.104901] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.104907] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.104982] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.104984] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [118.104986] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.104988] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.104989] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.104990] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.104992] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.104993] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [118.104995] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.104996] CR2: 00007ad854e91000 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [118.104997] PKRU: 55555554 <4> [118.104999] Call Trace: <4> [118.105000] <TASK> <4> [118.105004] ? lock_acquire+0x60/0x300 <4> [118.105009] ? lock_release+0xd0/0x2b0 <4> [118.105014] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.105020] process_one_work+0x239/0x740 <4> [118.105026] worker_thread+0x200/0x3f0 <4> [118.105029] ? __pfx_worker_thread+0x10/0x10 <4> [118.105032] kthread+0x10d/0x150 <4> [118.105034] ? __pfx_kthread+0x10/0x10 <4> [118.105037] ret_from_fork+0x3bd/0x470 <4> [118.105039] ? __pfx_kthread+0x10/0x10 <4> [118.105042] ret_from_fork_asm+0x1a/0x30 <4> [118.105050] </TASK> <4> [118.105051] irq event stamp: 1769739 <4> [118.105052] hardirqs last enabled at (1769745): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.105054] hardirqs last disabled at (1769750): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.105056] softirqs last enabled at (1768844): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.105059] softirqs last disabled at (1768833): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.105061] ---[ end trace 0000000000000000 ]--- <6> [118.105932] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [118.106038] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [118.106045] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [118.106083] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [118.106192] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [118.106302] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [118.106526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [118.106628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [118.106729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [118.106825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [118.106935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [118.107027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [118.107116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [118.107204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [118.107288] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [118.107389] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [118.107496] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [118.108533] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [118.118843] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [118.119099] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [118.120114] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [118.120204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [118.120286] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [118.120368] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [118.120447] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [118.120525] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [118.120603] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [118.120680] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [118.120757] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [118.120834] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [118.120928] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [118.121006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [118.121083] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [118.121160] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [118.121236] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [118.121312] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [118.121387] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [118.121463] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [118.121538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [118.121625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [118.121711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [118.121792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [118.121879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [118.121959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [118.122041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [118.122119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [118.122195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [118.122273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [118.122349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [118.122429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [118.122510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [118.122590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [118.122669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [118.122748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [118.122844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [118.122929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [118.123012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [118.123093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [118.123173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [118.123251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [118.123329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [118.123423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [118.123501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [118.123579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [118.123657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [118.123736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [118.123816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [118.123917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [118.123994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [118.124072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [118.124150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [118.124226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [118.124307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [118.124384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [118.124463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [118.124543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [118.124621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [118.124696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [118.124771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [118.124856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [118.124932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [118.125009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [118.125086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [118.125161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [118.125238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [118.125315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [118.125390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [118.125465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [118.125542] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [118.125664] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [118.125668] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43755, lrc_seqno=43755, guc_id=0, flags=0x73 in no process [-1] <7> [118.125671] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.125739] ------------[ cut here ]------------ <4> [118.125740] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.125741] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:8/1979 <4> [118.125820] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.125891] CPU: 8 UID: 0 PID: 1979 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.125894] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.125896] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.125897] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.125903] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.125979] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.125981] RSP: 0018:ffffc90001a5fca0 EFLAGS: 00010246 <4> [118.125983] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.125985] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.125986] RBP: ffffc90001a5fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.125987] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.125989] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.125990] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [118.125992] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.125993] CR2: 00007ad854e94000 CR3: 000000012c678006 CR4: 0000000000f72ef0 <4> [118.125995] PKRU: 55555554 <4> [118.125996] Call Trace: <4> [118.125997] <TASK> <4> [118.126001] ? lock_acquire+0x60/0x300 <4> [118.126006] ? lock_release+0xd0/0x2b0 <4> [118.126011] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.126017] process_one_work+0x239/0x740 <4> [118.126024] worker_thread+0x200/0x3f0 <4> [118.126027] ? __pfx_worker_thread+0x10/0x10 <4> [118.126030] kthread+0x10d/0x150 <4> [118.126032] ? __pfx_kthread+0x10/0x10 <4> [118.126035] ret_from_fork+0x3bd/0x470 <4> [118.126037] ? __pfx_kthread+0x10/0x10 <4> [118.126040] ret_from_fork_asm+0x1a/0x30 <4> [118.126048] </TASK> <4> [118.126049] irq event stamp: 318541 <4> [118.126050] hardirqs last enabled at (318547): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.126052] hardirqs last disabled at (318552): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.126054] softirqs last enabled at (317644): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.126057] softirqs last disabled at (317637): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.126059] ---[ end trace 0000000000000000 ]--- <5> [118.127415] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43810, lrc_seqno=43810, guc_id=0, flags=0x73 in no process [-1] <7> [118.127418] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.127488] ------------[ cut here ]------------ <4> [118.127489] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.127490] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:8/1979 <4> [118.127566] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.127631] CPU: 8 UID: 0 PID: 1979 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.127633] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.127634] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.127636] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.127641] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.127717] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.127719] RSP: 0018:ffffc90001a5fca0 EFLAGS: 00010246 <4> [118.127721] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.127722] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.127724] RBP: ffffc90001a5fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.127725] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.127726] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.127727] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [118.127729] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.127730] CR2: 00007ad854e94000 CR3: 000000012c678006 CR4: 0000000000f72ef0 <4> [118.127732] PKRU: 55555554 <4> [118.127733] Call Trace: <4> [118.127734] <TASK> <4> [118.127738] ? lock_acquire+0x60/0x300 <4> [118.127742] ? lock_release+0xd0/0x2b0 <4> [118.127747] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.127753] process_one_work+0x239/0x740 <4> [118.127759] worker_thread+0x200/0x3f0 <4> [118.127763] ? __pfx_worker_thread+0x10/0x10 <4> [118.127765] kthread+0x10d/0x150 <4> [118.127767] ? __pfx_kthread+0x10/0x10 <4> [118.127770] ret_from_fork+0x3bd/0x470 <4> [118.127773] ? __pfx_kthread+0x10/0x10 <4> [118.127775] ret_from_fork_asm+0x1a/0x30 <4> [118.127783] </TASK> <4> [118.127784] irq event stamp: 320419 <4> [118.127785] hardirqs last enabled at (320425): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.127787] hardirqs last disabled at (320430): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.127789] softirqs last enabled at (317644): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.127792] softirqs last disabled at (317637): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.127794] ---[ end trace 0000000000000000 ]--- <7> [118.127809] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <6> [118.127854] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [118.127984] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [118.127997] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [118.127965] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [118.128124] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [118.128395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [118.128545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [118.128696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [118.128856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [118.129001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [118.129142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [118.129284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [118.129428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [118.129567] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [118.129718] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [118.129871] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [118.131213] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [118.141871] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [118.142152] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [118.143200] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [118.143298] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [118.143386] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [118.143473] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [118.143559] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [118.143643] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [118.143725] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [118.143807] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [118.143900] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [118.143984] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [118.144068] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [118.144150] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [118.144236] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [118.144319] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [118.144402] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [118.144484] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [118.144566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [118.144648] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [118.144728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [118.144822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [118.144929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [118.145019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [118.145107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [118.145194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [118.145280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [118.145364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [118.145445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [118.145525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [118.145606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [118.145689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [118.145773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [118.145861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [118.145945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [118.146028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [118.146118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [118.146208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [118.146299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [118.146389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [118.146474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [118.146559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [118.146642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [118.146724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [118.146805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [118.146896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [118.146979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [118.147062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [118.147145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [118.147226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [118.147308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [118.147389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [118.147473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [118.147555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [118.147637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [118.147719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [118.147801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [118.147891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [118.147974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [118.148053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [118.148132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [118.148216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [118.148297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [118.148379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [118.148460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [118.148539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [118.148621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [118.148702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [118.148780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [118.148866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [118.148947] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [118.149073] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [118.149078] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43810, lrc_seqno=43810, guc_id=0, flags=0x73 in no process [-1] <7> [118.149080] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.149153] ------------[ cut here ]------------ <4> [118.149154] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.149155] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:2/119 <4> [118.149238] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.149305] CPU: 6 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.149308] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.149310] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.149311] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.149317] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.149397] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.149399] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [118.149402] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.149403] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.149405] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.149406] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.149407] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.149408] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [118.149410] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.149411] CR2: 00007372155f5008 CR3: 00000001450ef004 CR4: 0000000000f72ef0 <4> [118.149413] PKRU: 55555554 <4> [118.149414] Call Trace: <4> [118.149415] <TASK> <4> [118.149419] ? lock_acquire+0x60/0x300 <4> [118.149425] ? lock_release+0xd0/0x2b0 <4> [118.149430] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.149436] process_one_work+0x239/0x740 <4> [118.149443] worker_thread+0x200/0x3f0 <4> [118.149446] ? __pfx_worker_thread+0x10/0x10 <4> [118.149448] kthread+0x10d/0x150 <4> [118.149451] ? __pfx_kthread+0x10/0x10 <4> [118.149454] ret_from_fork+0x3bd/0x470 <4> [118.149456] ? __pfx_kthread+0x10/0x10 <4> [118.149459] ret_from_fork_asm+0x1a/0x30 <4> [118.149466] </TASK> <4> [118.149468] irq event stamp: 1774115 <4> [118.149469] hardirqs last enabled at (1774121): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.149471] hardirqs last disabled at (1774126): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.149473] softirqs last enabled at (1773272): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.149476] softirqs last disabled at (1773265): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.149478] ---[ end trace 0000000000000000 ]--- <6> [118.149480] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [118.149560] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [118.149566] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [118.150891] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [118.151002] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [118.151115] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [118.151327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [118.151422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [118.151519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [118.151610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [118.151699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [118.151787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [118.151882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [118.151972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [118.152057] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [118.152157] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [118.152251] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [118.153285] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [118.163844] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [118.164098] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [118.165214] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [118.165299] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [118.165379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [118.165460] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [118.165539] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [118.165618] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [118.165699] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [118.165778] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [118.165860] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [118.165937] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [118.166013] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [118.166088] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [118.166163] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [118.166238] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [118.166313] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [118.166389] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [118.166465] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [118.166540] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [118.166616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [118.166702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [118.166785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [118.166875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [118.166956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [118.167036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [118.167116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [118.167193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [118.167270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [118.167348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [118.167426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [118.167506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [118.167589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [118.167671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [118.167752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [118.167831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [118.167930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [118.168015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [118.168100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [118.168181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [118.168261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [118.168339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [118.168416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [118.168494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [118.168570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [118.168646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [118.168725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [118.168803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [118.168888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [118.168968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [118.169048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [118.169128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [118.169208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [118.169285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [118.169364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [118.169440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [118.169518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [118.169596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [118.169674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [118.169748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [118.169823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [118.169914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [118.169992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [118.170070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [118.170148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [118.170225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [118.170304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [118.170380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [118.170456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [118.170530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [118.170608] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [118.170727] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [118.170731] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43810, lrc_seqno=43810, guc_id=0, flags=0x73 in no process [-1] <7> [118.170734] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.170800] ------------[ cut here ]------------ <4> [118.170801] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.170803] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:2/119 <4> [118.170889] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.170956] CPU: 6 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.170958] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.170960] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.170961] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.170967] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.171043] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.171045] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [118.171047] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.171048] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.171050] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.171051] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.171052] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.171053] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [118.171055] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.171056] CR2: 00007372155f5008 CR3: 00000001450ef004 CR4: 0000000000f72ef0 <4> [118.171058] PKRU: 55555554 <4> [118.171059] Call Trace: <4> [118.171060] <TASK> <4> [118.171064] ? lock_acquire+0x60/0x300 <4> [118.171069] ? lock_release+0xd0/0x2b0 <4> [118.171074] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.171080] process_one_work+0x239/0x740 <4> [118.171086] worker_thread+0x200/0x3f0 <4> [118.171089] ? __pfx_worker_thread+0x10/0x10 <4> [118.171092] kthread+0x10d/0x150 <4> [118.171094] ? __pfx_kthread+0x10/0x10 <4> [118.171097] ret_from_fork+0x3bd/0x470 <4> [118.171099] ? __pfx_kthread+0x10/0x10 <4> [118.171102] ret_from_fork_asm+0x1a/0x30 <4> [118.171109] </TASK> <4> [118.171110] irq event stamp: 1777279 <4> [118.171112] hardirqs last enabled at (1777285): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.171114] hardirqs last disabled at (1777290): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.171115] softirqs last enabled at (1776298): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.171118] softirqs last disabled at (1776291): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.171121] ---[ end trace 0000000000000000 ]--- <5> [118.172312] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43865, lrc_seqno=43865, guc_id=0, flags=0x73 in no process [-1] <7> [118.172315] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.172386] ------------[ cut here ]------------ <4> [118.172387] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.172388] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:2/119 <4> [118.172464] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.172531] CPU: 6 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.172533] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.172534] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.172536] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.172541] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.172615] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.172616] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [118.172619] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.172620] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.172621] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.172622] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.172623] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.172625] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [118.172626] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.172627] CR2: 00007372155f5008 CR3: 00000001450ef004 CR4: 0000000000f72ef0 <4> [118.172629] PKRU: 55555554 <4> [118.172630] Call Trace: <4> [118.172631] <TASK> <4> [118.172635] ? lock_acquire+0x60/0x300 <4> [118.172639] ? lock_release+0xd0/0x2b0 <4> [118.172644] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.172650] process_one_work+0x239/0x740 <4> [118.172656] worker_thread+0x200/0x3f0 <4> [118.172659] ? __pfx_worker_thread+0x10/0x10 <4> [118.172662] kthread+0x10d/0x150 <4> [118.172664] ? __pfx_kthread+0x10/0x10 <4> [118.172667] ret_from_fork+0x3bd/0x470 <4> [118.172669] ? __pfx_kthread+0x10/0x10 <4> [118.172672] ret_from_fork_asm+0x1a/0x30 <4> [118.172680] </TASK> <4> [118.172681] irq event stamp: 1779157 <4> [118.172682] hardirqs last enabled at (1779163): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.172684] hardirqs last disabled at (1779168): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.172685] softirqs last enabled at (1776298): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.172688] softirqs last disabled at (1776291): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.172691] ---[ end trace 0000000000000000 ]--- <7> [118.172705] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [118.172815] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [118.172854] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [118.172982] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [118.172990] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [118.173037] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [118.173418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [118.173516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [118.173613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [118.173704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [118.173795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [118.173908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [118.173998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [118.174086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [118.174169] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [118.174270] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [118.174363] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [118.175405] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [118.186136] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [118.186394] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [118.187425] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [118.187511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [118.187592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [118.187672] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [118.187751] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [118.187827] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [118.187926] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [118.188004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [118.188081] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [118.188158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [118.188233] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [118.188307] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [118.188384] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [118.188459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [118.188534] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [118.188609] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [118.188682] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [118.188757] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [118.188831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [118.188931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [118.189017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [118.189099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [118.189177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [118.189256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [118.189335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [118.189414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [118.189492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [118.189570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [118.189648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [118.189727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [118.189807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [118.189895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [118.189975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [118.190056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [118.190143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [118.190231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [118.190315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [118.190397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [118.190477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [118.190554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [118.190630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [118.190707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [118.190783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [118.190866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [118.190945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [118.191022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [118.191099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [118.191174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [118.191249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [118.191326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [118.191407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [118.191484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [118.191561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [118.191637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [118.191712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [118.191790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [118.191873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [118.191949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [118.192024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [118.192110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [118.192191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [118.192269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [118.192347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [118.192425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [118.192504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [118.192582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [118.192658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [118.192735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [118.192815] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [118.192945] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [118.192949] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43865, lrc_seqno=43865, guc_id=0, flags=0x73 in no process [-1] <7> [118.192952] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.193021] ------------[ cut here ]------------ <4> [118.193022] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.193024] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#7: kworker/u64:2/119 <4> [118.193103] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.193182] CPU: 7 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.193186] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.193187] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.193189] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.193195] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.193272] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.193274] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [118.193276] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.193278] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.193279] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.193281] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.193282] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.193283] FS: 0000000000000000(0000) GS:ffff8888db003000(0000) knlGS:0000000000000000 <4> [118.193285] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.193286] CR2: 00007d0de26707f0 CR3: 000000000344a001 CR4: 0000000000f72ef0 <4> [118.193288] PKRU: 55555554 <4> [118.193289] Call Trace: <4> [118.193290] <TASK> <4> [118.193294] ? lock_acquire+0x60/0x300 <4> [118.193300] ? lock_release+0xd0/0x2b0 <4> [118.193304] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.193310] process_one_work+0x239/0x740 <4> [118.193318] worker_thread+0x200/0x3f0 <4> [118.193321] ? __pfx_worker_thread+0x10/0x10 <4> [118.193323] kthread+0x10d/0x150 <4> [118.193326] ? __pfx_kthread+0x10/0x10 <4> [118.193329] ret_from_fork+0x3bd/0x470 <4> [118.193331] ? __pfx_kthread+0x10/0x10 <4> [118.193334] ret_from_fork_asm+0x1a/0x30 <4> [118.193341] </TASK> <4> [118.193342] irq event stamp: 1782317 <4> [118.193344] hardirqs last enabled at (1782323): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.193346] hardirqs last disabled at (1782328): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.193347] softirqs last enabled at (1781314): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.193350] softirqs last disabled at (1781307): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.193353] ---[ end trace 0000000000000000 ]--- <6> [118.193355] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [118.193432] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [118.193438] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [118.194680] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [118.194792] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [118.194918] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [118.195150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [118.195252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [118.195352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [118.195443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [118.195532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [118.195618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [118.195705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [118.195793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [118.195931] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [118.196043] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [118.196139] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [118.197181] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [118.207847] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [118.208105] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [118.209131] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [118.209215] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [118.209295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [118.209378] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [118.209454] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [118.209532] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [118.209609] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [118.209685] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [118.209762] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [118.209845] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [118.209944] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [118.210021] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [118.210098] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [118.210174] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [118.210251] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [118.210327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [118.210403] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [118.210479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [118.210554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [118.210642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [118.210727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [118.210809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [118.210900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [118.211002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [118.211083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [118.211161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [118.211238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [118.211315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [118.211392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [118.211472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [118.211553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [118.211632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [118.211712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [118.211791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [118.211886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [118.211993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [118.212083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [118.212168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [118.212249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [118.212328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [118.212406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [118.212487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [118.212569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [118.212651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [118.212735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [118.212814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [118.212907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [118.213011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [118.213090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [118.213169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [118.213250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [118.213328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [118.213411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [118.213489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [118.213565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [118.213643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [118.213721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [118.213797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [118.213884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [118.213986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [118.214068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [118.214149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [118.214228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [118.214306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [118.214384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [118.214462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [118.214539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [118.214615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [118.214694] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [118.214816] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [118.214820] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43865, lrc_seqno=43865, guc_id=0, flags=0x73 in no process [-1] <7> [118.214823] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.215083] ------------[ cut here ]------------ <4> [118.215087] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.215091] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:8/1979 <4> [118.215467] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.215597] CPU: 8 UID: 0 PID: 1979 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.215603] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.215606] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.215608] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.215627] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.215811] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.215813] RSP: 0018:ffffc90001a5fca0 EFLAGS: 00010246 <4> [118.215815] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.215817] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.215818] RBP: ffffc90001a5fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.215819] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.215821] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.215822] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [118.215824] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.215825] CR2: 00007ad854e94000 CR3: 000000012c678006 CR4: 0000000000f72ef0 <4> [118.215826] PKRU: 55555554 <4> [118.215828] Call Trace: <4> [118.215829] <TASK> <4> [118.215833] ? lock_acquire+0x60/0x300 <4> [118.215850] ? lock_release+0xd0/0x2b0 <4> [118.215856] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.215868] process_one_work+0x239/0x740 <4> [118.215880] worker_thread+0x200/0x3f0 <4> [118.215885] ? __pfx_worker_thread+0x10/0x10 <4> [118.215889] kthread+0x10d/0x150 <4> [118.215893] ? __pfx_kthread+0x10/0x10 <4> [118.215897] ret_from_fork+0x3bd/0x470 <4> [118.215900] ? __pfx_kthread+0x10/0x10 <4> [118.215905] ret_from_fork_asm+0x1a/0x30 <4> [118.215916] </TASK> <4> [118.215918] irq event stamp: 326005 <4> [118.215920] hardirqs last enabled at (326011): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.215923] hardirqs last disabled at (326016): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.215926] softirqs last enabled at (325934): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.215931] softirqs last disabled at (325921): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.215934] ---[ end trace 0000000000000000 ]--- <7> [118.215878] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [118.216014] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [118.216358] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43920, lrc_seqno=43920, guc_id=0, flags=0x73 in no process [-1] <7> [118.216365] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.216483] ------------[ cut here ]------------ <4> [118.216485] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.216487] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#12: kworker/u64:5/202 <4> [118.216613] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.216716] CPU: 12 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.216720] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.216722] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.216724] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.216732] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.216861] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.216864] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [118.216868] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.216870] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.216872] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.216874] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.216876] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.216878] FS: 0000000000000000(0000) GS:ffff8888db283000(0000) knlGS:0000000000000000 <4> [118.216881] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.216883] CR2: 000060af2df35d48 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [118.216885] PKRU: 55555554 <4> [118.216887] Call Trace: <4> [118.216889] <TASK> <4> [118.216896] ? lock_acquire+0x60/0x300 <4> [118.216904] ? lock_release+0xd0/0x2b0 <4> [118.216912] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.216922] process_one_work+0x239/0x740 <4> [118.216934] worker_thread+0x200/0x3f0 <4> [118.216938] ? __pfx_worker_thread+0x10/0x10 <4> [118.216942] kthread+0x10d/0x150 <4> [118.216945] ? __pfx_kthread+0x10/0x10 <4> [118.216950] ret_from_fork+0x3bd/0x470 <4> [118.216953] ? __pfx_kthread+0x10/0x10 <4> [118.216957] ret_from_fork_asm+0x1a/0x30 <4> [118.216970] </TASK> <4> [118.216971] irq event stamp: 1896813 <4> [118.216973] hardirqs last enabled at (1896819): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.216976] hardirqs last disabled at (1896824): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.216979] softirqs last enabled at (1896652): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.216982] softirqs last disabled at (1896647): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.216986] ---[ end trace 0000000000000000 ]--- <6> [118.216988] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [118.217110] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [118.217119] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [118.217345] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [118.217606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [118.217758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [118.217872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [118.217967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [118.218058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [118.218145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [118.218233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [118.218321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [118.218405] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [118.218506] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [118.218599] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [118.219642] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [118.229846] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [118.230105] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [118.231170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [118.231258] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [118.231339] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [118.231419] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [118.231496] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [118.231572] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [118.231648] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [118.231725] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [118.231801] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [118.231892] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [118.231969] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [118.232043] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [118.232120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [118.232196] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [118.232270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [118.232345] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [118.232419] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [118.232495] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [118.232573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [118.232660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [118.232745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [118.232827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [118.232923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [118.233004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [118.233084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [118.233162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [118.233240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [118.233316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [118.233392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [118.233473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [118.233557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [118.233637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [118.233717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [118.233803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [118.233899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [118.233983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [118.234067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [118.234148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [118.234227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [118.234303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [118.234381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [118.234458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [118.234534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [118.234612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [118.234691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [118.234768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [118.234851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [118.234929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [118.235002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [118.235079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [118.235158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [118.235233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [118.235310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [118.235386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [118.235462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [118.235538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [118.235614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [118.235689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [118.235764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [118.235850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [118.235934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [118.236013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [118.236092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [118.236169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [118.236247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [118.236324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [118.236400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [118.236476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [118.236554] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [118.236679] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [118.236683] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43920, lrc_seqno=43920, guc_id=0, flags=0x73 in no process [-1] <7> [118.236686] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.236753] ------------[ cut here ]------------ <4> [118.236755] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.236756] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:5/202 <4> [118.236835] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.236954] CPU: 6 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.236957] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.236958] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.236960] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.236966] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.237044] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.237045] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [118.237048] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.237049] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.237050] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.237052] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.237053] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.237054] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [118.237056] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.237057] CR2: 00007372155f5008 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [118.237059] PKRU: 55555554 <4> [118.237060] Call Trace: <4> [118.237061] <TASK> <4> [118.237065] ? lock_acquire+0x60/0x300 <4> [118.237071] ? lock_release+0xd0/0x2b0 <4> [118.237075] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.237082] process_one_work+0x239/0x740 <4> [118.237089] worker_thread+0x200/0x3f0 <4> [118.237092] ? __pfx_worker_thread+0x10/0x10 <4> [118.237095] kthread+0x10d/0x150 <4> [118.237097] ? __pfx_kthread+0x10/0x10 <4> [118.237100] ret_from_fork+0x3bd/0x470 <4> [118.237102] ? __pfx_kthread+0x10/0x10 <4> [118.237105] ret_from_fork_asm+0x1a/0x30 <4> [118.237113] </TASK> <4> [118.237114] irq event stamp: 1899987 <4> [118.237115] hardirqs last enabled at (1899993): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.237118] hardirqs last disabled at (1899998): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.237119] softirqs last enabled at (1899090): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.237122] softirqs last disabled at (1899075): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.237125] ---[ end trace 0000000000000000 ]--- <6> [118.237127] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [118.237203] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [118.237210] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [118.238460] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [118.238570] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [118.238681] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [118.238900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [118.238992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [118.239087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [118.239174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [118.239261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [118.239344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [118.239430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [118.239517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [118.239600] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [118.239699] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [118.239792] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [118.240852] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [118.250849] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [118.251113] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [118.252094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [118.252181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [118.252262] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [118.252342] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [118.252418] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [118.252494] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [118.252568] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [118.252644] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [118.252721] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [118.252797] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [118.252884] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [118.252962] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [118.253041] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [118.253118] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [118.253195] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [118.253271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [118.253347] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [118.253423] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [118.253498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [118.253584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [118.253669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [118.253750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [118.253828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [118.253927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [118.254009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [118.254087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [118.254166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [118.254243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [118.254324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [118.254407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [118.254488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [118.254567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [118.254646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [118.254725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [118.254810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [118.254908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [118.254992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [118.255072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [118.255150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [118.255227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [118.255302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [118.255379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [118.255456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [118.255533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [118.255617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [118.255696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [118.255775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [118.255861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [118.255940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [118.256018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [118.256098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [118.256174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [118.256251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [118.256327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [118.256402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [118.256479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [118.256555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [118.256628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [118.256703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [118.256780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [118.256862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [118.256939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [118.257014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [118.257088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [118.257165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [118.257242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [118.257316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [118.257390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [118.257468] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [118.257593] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [118.257597] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43920, lrc_seqno=43920, guc_id=0, flags=0x73 in no process [-1] <7> [118.257599] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.257667] ------------[ cut here ]------------ <4> [118.257668] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.257670] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#7: kworker/u64:2/119 <4> [118.257755] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.257822] CPU: 7 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.257825] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.257827] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.257828] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.257834] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.257929] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.257930] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [118.257933] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.257935] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.257936] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.257938] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.257939] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.257941] FS: 0000000000000000(0000) GS:ffff8888db003000(0000) knlGS:0000000000000000 <4> [118.257943] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.257944] CR2: 00007d0de26707f0 CR3: 000000000344a001 CR4: 0000000000f72ef0 <4> [118.257946] PKRU: 55555554 <4> [118.257947] Call Trace: <4> [118.257948] <TASK> <4> [118.257952] ? lock_acquire+0x60/0x300 <4> [118.257957] ? lock_release+0xd0/0x2b0 <4> [118.257963] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.257969] process_one_work+0x239/0x740 <4> [118.257975] worker_thread+0x200/0x3f0 <4> [118.257979] ? __pfx_worker_thread+0x10/0x10 <4> [118.257981] kthread+0x10d/0x150 <4> [118.257984] ? __pfx_kthread+0x10/0x10 <4> [118.257987] ret_from_fork+0x3bd/0x470 <4> [118.257990] ? __pfx_kthread+0x10/0x10 <4> [118.257992] ret_from_fork_asm+0x1a/0x30 <4> [118.258000] </TASK> <4> [118.258001] irq event stamp: 1787025 <4> [118.258002] hardirqs last enabled at (1787031): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.258005] hardirqs last disabled at (1787036): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.258006] softirqs last enabled at (1785956): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.258009] softirqs last disabled at (1785949): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.258012] ---[ end trace 0000000000000000 ]--- <7> [118.259060] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [118.259173] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [118.259381] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43975, lrc_seqno=43975, guc_id=0, flags=0x73 in no process [-1] <7> [118.259385] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.259482] ------------[ cut here ]------------ <4> [118.259484] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.259486] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:2/119 <4> [118.259570] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.259650] CPU: 11 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.259653] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.259655] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.259657] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.259663] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.259742] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.259744] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [118.259746] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.259748] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.259749] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.259750] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.259752] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.259753] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [118.259755] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.259756] CR2: 00007d0de2741560 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [118.259758] PKRU: 55555554 <4> [118.259759] Call Trace: <4> [118.259760] <TASK> <4> [118.259764] ? lock_acquire+0x60/0x300 <4> [118.259769] ? lock_release+0xd0/0x2b0 <4> [118.259774] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.259780] process_one_work+0x239/0x740 <4> [118.259786] worker_thread+0x200/0x3f0 <4> [118.259790] ? __pfx_worker_thread+0x10/0x10 <4> [118.259792] kthread+0x10d/0x150 <4> [118.259795] ? __pfx_kthread+0x10/0x10 <4> [118.259798] ret_from_fork+0x3bd/0x470 <4> [118.259800] ? __pfx_kthread+0x10/0x10 <4> [118.259803] ret_from_fork_asm+0x1a/0x30 <4> [118.259810] </TASK> <4> [118.259811] irq event stamp: 1788883 <4> [118.259813] hardirqs last enabled at (1788889): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.259815] hardirqs last disabled at (1788894): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.259817] softirqs last enabled at (1785956): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.259819] softirqs last disabled at (1785949): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.259822] ---[ end trace 0000000000000000 ]--- <6> [118.259824] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [118.259948] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [118.259964] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [118.260176] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [118.260391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [118.260489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [118.260589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [118.260683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [118.260773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [118.260870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [118.260984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [118.261076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [118.261161] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [118.261264] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [118.261356] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [118.262423] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [118.272846] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [118.273125] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [118.274286] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [118.274364] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [118.274439] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [118.274513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [118.274586] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [118.274659] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [118.274732] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [118.274803] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [118.274904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [118.275003] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [118.275081] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [118.275158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [118.275235] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [118.275311] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [118.275387] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [118.275463] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [118.275538] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [118.275614] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [118.275689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [118.275775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [118.275866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [118.275969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [118.276051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [118.276134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [118.276217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [118.276296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [118.276374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [118.276451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [118.276528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [118.276607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [118.276686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [118.276763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [118.276847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [118.276936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [118.277020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [118.277104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [118.277188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [118.277268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [118.277347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [118.277423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [118.277500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [118.277576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [118.277651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [118.277728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [118.277807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [118.277900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [118.277977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [118.278054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [118.278130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [118.278206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [118.278285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [118.278361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [118.278437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [118.278512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [118.278586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [118.278663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [118.278739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [118.278812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [118.278902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [118.278985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [118.279063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [118.279141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [118.279217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [118.279292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [118.279370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [118.279446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [118.279522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [118.279596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [118.279673] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [118.279794] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [118.279799] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43975, lrc_seqno=43975, guc_id=0, flags=0x73 in no process [-1] <7> [118.279801] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.279881] ------------[ cut here ]------------ <4> [118.279882] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.279883] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:2/119 <4> [118.279962] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.280028] CPU: 11 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.280031] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.280032] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.280034] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.280039] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.280116] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.280117] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [118.280120] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.280121] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.280123] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.280124] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.280125] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.280126] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [118.280128] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.280129] CR2: 00007d0de2741560 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [118.280131] PKRU: 55555554 <4> [118.280132] Call Trace: <4> [118.280133] <TASK> <4> [118.280137] ? lock_acquire+0x60/0x300 <4> [118.280142] ? lock_release+0xd0/0x2b0 <4> [118.280147] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.280153] process_one_work+0x239/0x740 <4> [118.280160] worker_thread+0x200/0x3f0 <4> [118.280163] ? __pfx_worker_thread+0x10/0x10 <4> [118.280166] kthread+0x10d/0x150 <4> [118.280168] ? __pfx_kthread+0x10/0x10 <4> [118.280171] ret_from_fork+0x3bd/0x470 <4> [118.280173] ? __pfx_kthread+0x10/0x10 <4> [118.280175] ret_from_fork_asm+0x1a/0x30 <4> [118.280183] </TASK> <4> [118.280184] irq event stamp: 1792071 <4> [118.280185] hardirqs last enabled at (1792077): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.280188] hardirqs last disabled at (1792082): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.280189] softirqs last enabled at (1791168): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.280192] softirqs last disabled at (1791161): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.280195] ---[ end trace 0000000000000000 ]--- <6> [118.280196] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [118.280272] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [118.280278] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [118.280683] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [118.280914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [118.281004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [118.281097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [118.281186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [118.281273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [118.281358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [118.281445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [118.281531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [118.281614] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [118.281713] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [118.281808] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [118.282853] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [118.293582] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [118.293830] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [118.294896] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [118.294980] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [118.295061] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [118.295139] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [118.295220] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [118.295300] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [118.295377] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [118.295452] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [118.295527] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [118.295604] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [118.295683] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [118.295760] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [118.295835] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [118.295928] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [118.296003] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [118.296080] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [118.296154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [118.296230] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [118.296305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [118.296391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [118.296475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [118.296555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [118.296634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [118.296714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [118.296796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [118.296881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [118.296959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [118.297036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [118.297112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [118.297191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [118.297271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [118.297350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [118.297428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [118.297507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [118.297590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [118.297674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [118.297757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [118.298135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [118.298233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [118.298319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [118.298401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [118.298482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [118.298560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [118.298639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [118.298719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [118.298797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [118.298886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [118.298964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [118.299041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [118.299120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [118.299199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [118.299277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [118.299355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [118.299431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [118.299507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [118.299584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [118.299665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [118.299742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [118.299818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [118.299906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [118.299984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [118.300062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [118.300137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [118.300214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [118.300291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [118.300368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [118.300444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [118.300518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [118.300596] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [118.300717] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [118.300721] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=43975, lrc_seqno=43975, guc_id=0, flags=0x73 in no process [-1] <7> [118.300724] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.300791] ------------[ cut here ]------------ <4> [118.300792] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.300794] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:2/119 <4> [118.300881] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.300948] CPU: 11 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.300951] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.300952] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.300954] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.300960] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.301035] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.301037] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [118.301039] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.301041] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.301042] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.301043] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.301044] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.301046] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [118.301047] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.301049] CR2: 00007d0de2741560 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [118.301050] PKRU: 55555554 <4> [118.301051] Call Trace: <4> [118.301052] <TASK> <4> [118.301056] ? lock_acquire+0x60/0x300 <4> [118.301061] ? lock_release+0xd0/0x2b0 <4> [118.301066] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.301072] process_one_work+0x239/0x740 <4> [118.301078] worker_thread+0x200/0x3f0 <4> [118.301081] ? __pfx_worker_thread+0x10/0x10 <4> [118.301084] kthread+0x10d/0x150 <4> [118.301086] ? __pfx_kthread+0x10/0x10 <4> [118.301089] ret_from_fork+0x3bd/0x470 <4> [118.301091] ? __pfx_kthread+0x10/0x10 <4> [118.301094] ret_from_fork_asm+0x1a/0x30 <4> [118.301101] </TASK> <4> [118.301103] irq event stamp: 1795245 <4> [118.301104] hardirqs last enabled at (1795251): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.301106] hardirqs last disabled at (1795256): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.301108] softirqs last enabled at (1794348): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.301110] softirqs last disabled at (1794341): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.301113] ---[ end trace 0000000000000000 ]--- <7> [118.302369] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <5> [118.302520] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44030, lrc_seqno=44030, guc_id=0, flags=0x73 in no process [-1] <7> [118.302484] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [118.302527] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.302645] ------------[ cut here ]------------ <4> [118.302647] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.302649] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#12: kworker/u64:8/1979 <4> [118.302775] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.302881] CPU: 12 UID: 0 PID: 1979 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.302886] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.302887] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.302889] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.302898] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.303020] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.303022] RSP: 0018:ffffc90001a5fca0 EFLAGS: 00010246 <4> [118.303025] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.303027] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.303029] RBP: ffffc90001a5fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.303031] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.303033] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.303035] FS: 0000000000000000(0000) GS:ffff8888db283000(0000) knlGS:0000000000000000 <4> [118.303037] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.303039] CR2: 000060af2df35d48 CR3: 000000000344a006 CR4: 0000000000f72ef0 <4> [118.303041] PKRU: 55555554 <4> [118.303043] Call Trace: <4> [118.303044] <TASK> <4> [118.303051] ? lock_acquire+0x60/0x300 <4> [118.303059] ? lock_release+0xd0/0x2b0 <4> [118.303067] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.303076] process_one_work+0x239/0x740 <4> [118.303087] worker_thread+0x200/0x3f0 <4> [118.303092] ? __pfx_worker_thread+0x10/0x10 <4> [118.303095] kthread+0x10d/0x150 <4> [118.303098] ? __pfx_kthread+0x10/0x10 <4> [118.303103] ret_from_fork+0x3bd/0x470 <4> [118.303106] ? __pfx_kthread+0x10/0x10 <4> [118.303110] ret_from_fork_asm+0x1a/0x30 <4> [118.303122] </TASK> <4> [118.303124] irq event stamp: 329959 <4> [118.303125] hardirqs last enabled at (329965): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.303129] hardirqs last disabled at (329970): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.303131] softirqs last enabled at (329572): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.303135] softirqs last disabled at (329565): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.303138] ---[ end trace 0000000000000000 ]--- <6> [118.303150] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [118.303238] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [118.303245] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [118.303461] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [118.303675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [118.303772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [118.303874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [118.303965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [118.304054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [118.304140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [118.304229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [118.304317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [118.304401] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [118.304502] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [118.304597] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [118.305632] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [118.315847] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [118.316105] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [118.317139] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [118.317227] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [118.317309] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [118.317391] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [118.317471] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [118.317550] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [118.317628] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [118.317705] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [118.317782] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [118.317866] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [118.317944] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [118.318025] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [118.318104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [118.318183] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [118.318261] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [118.318338] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [118.318416] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [118.318495] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [118.318573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [118.318660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [118.318746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [118.318828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [118.318922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [118.319004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [118.319083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [118.319162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [118.319241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [118.319318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [118.319396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [118.319476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [118.319556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [118.319634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [118.319714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [118.319793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [118.319888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [118.319973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [118.320058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [118.320139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [118.320217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [118.320295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [118.320372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [118.320448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [118.320525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [118.320603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [118.320682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [118.320761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [118.320853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [118.320931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [118.321008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [118.321085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [118.321164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [118.321241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [118.321322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [118.321400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [118.321483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [118.321567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [118.321650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [118.321730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [118.321807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [118.321907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [118.321986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [118.322065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [118.322155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [118.322233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [118.322310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [118.322387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [118.322463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [118.322540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [118.322619] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [118.322742] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [118.322746] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44030, lrc_seqno=44030, guc_id=0, flags=0x73 in no process [-1] <7> [118.322748] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.322816] ------------[ cut here ]------------ <4> [118.322817] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.322819] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:8/1979 <4> [118.322907] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.322976] CPU: 6 UID: 0 PID: 1979 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.322979] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.322980] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.322982] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.322988] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.323065] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.323067] RSP: 0018:ffffc90001a5fca0 EFLAGS: 00010246 <4> [118.323069] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.323070] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.323072] RBP: ffffc90001a5fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.323073] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.323074] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.323076] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [118.323077] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.323079] CR2: 00007372155f5008 CR3: 000000000344a005 CR4: 0000000000f72ef0 <4> [118.323080] PKRU: 55555554 <4> [118.323081] Call Trace: <4> [118.323082] <TASK> <4> [118.323086] ? lock_acquire+0x60/0x300 <4> [118.323092] ? lock_release+0xd0/0x2b0 <4> [118.323097] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.323103] process_one_work+0x239/0x740 <4> [118.323109] worker_thread+0x200/0x3f0 <4> [118.323112] ? __pfx_worker_thread+0x10/0x10 <4> [118.323115] kthread+0x10d/0x150 <4> [118.323117] ? __pfx_kthread+0x10/0x10 <4> [118.323120] ret_from_fork+0x3bd/0x470 <4> [118.323122] ? __pfx_kthread+0x10/0x10 <4> [118.323125] ret_from_fork_asm+0x1a/0x30 <4> [118.323132] </TASK> <4> [118.323134] irq event stamp: 333155 <4> [118.323135] hardirqs last enabled at (333161): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.323137] hardirqs last disabled at (333166): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.323139] softirqs last enabled at (332250): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.323141] softirqs last disabled at (332243): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.323144] ---[ end trace 0000000000000000 ]--- <6> [118.323846] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [118.323972] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [118.323984] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [118.324396] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [118.324510] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [118.324623] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [118.324855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [118.324959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [118.325061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [118.325159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [118.325253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [118.325342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [118.325429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [118.325517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [118.325599] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [118.325701] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [118.325796] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [118.326847] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [118.336848] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [118.337112] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [118.338100] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [118.338188] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [118.338271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [118.338354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [118.338434] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [118.338513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [118.338592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [118.338670] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [118.338748] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [118.338826] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [118.338922] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [118.339002] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [118.339088] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [118.339170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [118.339250] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [118.339328] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [118.339406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [118.339483] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [118.339560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [118.339648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [118.339733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [118.339819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [118.339915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [118.340000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [118.340083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [118.340162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [118.340240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [118.340317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [118.340394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [118.340473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [118.340556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [118.340637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [118.340719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [118.340799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [118.340895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [118.340980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [118.341064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [118.341145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [118.341224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [118.341301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [118.341378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [118.341455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [118.341531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [118.341607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [118.341685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [118.341762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [118.341846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [118.341926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [118.342001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [118.342078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [118.342156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [118.342232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [118.342307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [118.342383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [118.342464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [118.342542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [118.342620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [118.342699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [118.342776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [118.342862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [118.342942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [118.343021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [118.343096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [118.343172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [118.343248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [118.343324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [118.343397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [118.343476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [118.343557] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [118.343678] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [118.343683] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44030, lrc_seqno=44030, guc_id=0, flags=0x73 in no process [-1] <7> [118.344539] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.344609] ------------[ cut here ]------------ <4> [118.344611] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.344612] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#2: kworker/u64:2/119 <4> [118.344691] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.344760] CPU: 2 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.344763] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.344764] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.344765] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.344772] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.344853] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.344855] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [118.344858] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.344859] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.344861] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.344862] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.344863] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.344865] FS: 0000000000000000(0000) GS:ffff8888dad83000(0000) knlGS:0000000000000000 <4> [118.344866] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.344868] CR2: 00007ad8440643a8 CR3: 000000011d065005 CR4: 0000000000f72ef0 <4> [118.344869] PKRU: 55555554 <4> [118.344871] Call Trace: <4> [118.344872] <TASK> <4> [118.344876] ? lock_acquire+0x60/0x300 <4> [118.344882] ? lock_release+0xd0/0x2b0 <4> [118.344887] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.344894] process_one_work+0x239/0x740 <4> [118.344901] worker_thread+0x200/0x3f0 <4> [118.344904] ? __pfx_worker_thread+0x10/0x10 <4> [118.344907] kthread+0x10d/0x150 <4> [118.344909] ? __pfx_kthread+0x10/0x10 <4> [118.344912] ret_from_fork+0x3bd/0x470 <4> [118.344914] ? __pfx_kthread+0x10/0x10 <4> [118.344917] ret_from_fork_asm+0x1a/0x30 <4> [118.344925] </TASK> <4> [118.344926] irq event stamp: 1799671 <4> [118.344927] hardirqs last enabled at (1799677): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.344929] hardirqs last disabled at (1799682): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.344931] softirqs last enabled at (1799510): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.344934] softirqs last disabled at (1799499): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.344936] ---[ end trace 0000000000000000 ]--- <7> [118.345007] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [118.345162] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [118.345427] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44085, lrc_seqno=44085, guc_id=0, flags=0x73 in no process [-1] <7> [118.345432] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.345508] ------------[ cut here ]------------ <4> [118.345509] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.345511] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:2/119 <4> [118.345596] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.345662] CPU: 1 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.345665] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.345667] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.345668] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.345674] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.345756] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.345758] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [118.345760] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.345762] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.345763] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.345764] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.345765] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.345767] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [118.345768] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.345770] CR2: 00007ad854e97000 CR3: 000000012c678003 CR4: 0000000000f72ef0 <4> [118.345771] PKRU: 55555554 <4> [118.345773] Call Trace: <4> [118.345774] <TASK> <4> [118.345778] ? lock_acquire+0x60/0x300 <4> [118.345783] ? lock_release+0xd0/0x2b0 <4> [118.345788] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.345794] process_one_work+0x239/0x740 <4> [118.345800] worker_thread+0x200/0x3f0 <4> [118.345804] ? __pfx_worker_thread+0x10/0x10 <4> [118.345806] kthread+0x10d/0x150 <4> [118.345809] ? __pfx_kthread+0x10/0x10 <4> [118.345812] ret_from_fork+0x3bd/0x470 <4> [118.345814] ? __pfx_kthread+0x10/0x10 <4> [118.345817] ret_from_fork_asm+0x1a/0x30 <4> [118.345824] </TASK> <4> [118.345825] irq event stamp: 1801989 <4> [118.345827] hardirqs last enabled at (1801995): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.345829] hardirqs last disabled at (1802000): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.345831] softirqs last enabled at (1799510): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.345834] softirqs last disabled at (1799499): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.345848] ---[ end trace 0000000000000000 ]--- <6> [118.345851] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [118.345932] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [118.345941] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [118.345993] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [118.346259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [118.346368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [118.346470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [118.346564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [118.346656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [118.346747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [118.346846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [118.346937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [118.347020] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [118.347122] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [118.347215] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [118.348255] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [118.358847] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [118.359114] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [118.360145] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [118.360235] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [118.360319] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [118.360403] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [118.360485] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [118.360565] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [118.360644] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [118.360722] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [118.360801] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [118.360911] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [118.360989] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [118.361065] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [118.361141] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [118.361217] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [118.361292] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [118.361368] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [118.361443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [118.361519] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [118.361594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [118.361681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [118.361764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [118.361853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [118.361934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [118.362015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [118.362096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [118.362175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [118.362253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [118.362330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [118.362406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [118.362485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [118.362571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [118.362654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [118.362734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [118.362814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [118.362910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [118.362996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [118.363081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [118.363162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [118.363241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [118.363320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [118.363399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [118.363475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [118.363551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [118.363628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [118.363707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [118.363784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [118.363869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [118.363946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [118.364022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [118.364099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [118.364179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [118.364255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [118.364332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [118.364411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [118.364491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [118.364571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [118.364651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [118.364728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [118.364808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [118.364902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [118.364982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [118.365061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [118.365138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [118.365213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [118.365292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [118.365367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [118.365443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [118.365519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [118.365597] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [118.365723] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [118.365727] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44085, lrc_seqno=44085, guc_id=0, flags=0x73 in no process [-1] <7> [118.365730] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.365797] ------------[ cut here ]------------ <4> [118.365798] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.365800] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:8/1979 <4> [118.365902] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.365969] CPU: 10 UID: 0 PID: 1979 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.365973] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.365974] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.365975] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.365981] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.366059] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.366061] RSP: 0018:ffffc90001a5fca0 EFLAGS: 00010246 <4> [118.366063] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.366065] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.366066] RBP: ffffc90001a5fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.366067] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.366068] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.366070] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [118.366072] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.366073] CR2: 00007d0de11e62f4 CR3: 000000011d065005 CR4: 0000000000f72ef0 <4> [118.366074] PKRU: 55555554 <4> [118.366076] Call Trace: <4> [118.366077] <TASK> <4> [118.366081] ? lock_acquire+0x60/0x300 <4> [118.366086] ? lock_release+0xd0/0x2b0 <4> [118.366090] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.366096] process_one_work+0x239/0x740 <4> [118.366103] worker_thread+0x200/0x3f0 <4> [118.366106] ? __pfx_worker_thread+0x10/0x10 <4> [118.366109] kthread+0x10d/0x150 <4> [118.366111] ? __pfx_kthread+0x10/0x10 <4> [118.366114] ret_from_fork+0x3bd/0x470 <4> [118.366117] ? __pfx_kthread+0x10/0x10 <4> [118.366119] ret_from_fork_asm+0x1a/0x30 <4> [118.366127] </TASK> <4> [118.366128] irq event stamp: 337571 <4> [118.366129] hardirqs last enabled at (337577): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.366131] hardirqs last disabled at (337582): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.366133] softirqs last enabled at (336674): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.366136] softirqs last disabled at (336663): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.366139] ---[ end trace 0000000000000000 ]--- <6> [118.366941] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [118.367078] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [118.367086] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [118.367160] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [118.367271] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [118.367381] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [118.367593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [118.367692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [118.367791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [118.367901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [118.367992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [118.368079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [118.368165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [118.368252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [118.368337] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [118.368438] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [118.368533] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [118.369572] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [118.380194] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [118.380442] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [118.381459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [118.381536] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [118.381607] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [118.381680] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [118.381753] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [118.381825] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [118.381914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [118.381993] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [118.382069] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [118.382145] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [118.382221] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [118.382296] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [118.382372] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [118.382448] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [118.382524] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [118.382599] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [118.382675] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [118.382751] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [118.382827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [118.382927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [118.383012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [118.383096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [118.383176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [118.383256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [118.383336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [118.383414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [118.383492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [118.383569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [118.383647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [118.383727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [118.383807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [118.383901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [118.383983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [118.384063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [118.384148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [118.384233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [118.384318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [118.384398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [118.384477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [118.384556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [118.384635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [118.384713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [118.384790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [118.384881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [118.384961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [118.385040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [118.385118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [118.385195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [118.385272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [118.385349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [118.385429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [118.385505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [118.385582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [118.385658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [118.385734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [118.385811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [118.385903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [118.385980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [118.386055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [118.386133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [118.386209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [118.386287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [118.386364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [118.386438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [118.386518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [118.386594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [118.386670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [118.386745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [118.386824] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [118.386961] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [118.386966] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44085, lrc_seqno=44085, guc_id=0, flags=0x73 in no process [-1] <7> [118.386968] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.387037] ------------[ cut here ]------------ <4> [118.387038] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.387039] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:2/119 <4> [118.387119] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.387185] CPU: 1 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.387188] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.387189] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.387190] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.387196] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.387272] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.387274] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [118.387276] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.387278] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.387279] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.387280] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.387281] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.387283] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [118.387284] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.387286] CR2: 00007ad854e97000 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [118.387287] PKRU: 55555554 <4> [118.387288] Call Trace: <4> [118.387289] <TASK> <4> [118.387293] ? lock_acquire+0x60/0x300 <4> [118.387298] ? lock_release+0xd0/0x2b0 <4> [118.387303] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.387309] process_one_work+0x239/0x740 <4> [118.387315] worker_thread+0x200/0x3f0 <4> [118.387318] ? __pfx_worker_thread+0x10/0x10 <4> [118.387321] kthread+0x10d/0x150 <4> [118.387323] ? __pfx_kthread+0x10/0x10 <4> [118.387326] ret_from_fork+0x3bd/0x470 <4> [118.387328] ? __pfx_kthread+0x10/0x10 <4> [118.387331] ret_from_fork_asm+0x1a/0x30 <4> [118.387338] </TASK> <4> [118.387340] irq event stamp: 1805439 <4> [118.387341] hardirqs last enabled at (1805445): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.387343] hardirqs last disabled at (1805450): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.387345] softirqs last enabled at (1804610): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.387348] softirqs last disabled at (1804603): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.387350] ---[ end trace 0000000000000000 ]--- <5> [118.388950] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44140, lrc_seqno=44140, guc_id=0, flags=0x73 in no process [-1] <7> [118.388955] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [118.388960] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [118.389037] ------------[ cut here ]------------ <4> [118.389038] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.389039] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:5/202 <4> [118.389123] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb <7> [118.389077] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [118.389128] mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.389191] CPU: 11 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.389194] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.389196] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.389197] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.389203] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.389281] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.389282] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [118.389285] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.389286] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.389287] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.389289] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.389290] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.389291] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [118.389293] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.389294] CR2: 00007d0de2741560 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [118.389296] PKRU: 55555554 <4> [118.389297] Call Trace: <4> [118.389298] <TASK> <4> [118.389302] ? lock_acquire+0x60/0x300 <4> [118.389307] ? lock_release+0xd0/0x2b0 <4> [118.389312] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.389318] process_one_work+0x239/0x740 <4> [118.389325] worker_thread+0x200/0x3f0 <4> [118.389328] ? __pfx_worker_thread+0x10/0x10 <4> [118.389330] kthread+0x10d/0x150 <4> [118.389333] ? __pfx_kthread+0x10/0x10 <4> [118.389335] ret_from_fork+0x3bd/0x470 <4> [118.389338] ? __pfx_kthread+0x10/0x10 <4> [118.389341] ret_from_fork_asm+0x1a/0x30 <4> [118.389348] </TASK> <4> [118.389349] irq event stamp: 1904315 <4> [118.389350] hardirqs last enabled at (1904321): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.389353] hardirqs last disabled at (1904326): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.389354] softirqs last enabled at (1903294): [<ffffffff8133ad53>] kernel_fpu_end+0x53/0x70 <4> [118.389357] softirqs last disabled at (1903292): [<ffffffff8133b464>] kernel_fpu_begin_mask+0xc4/0x120 <4> [118.389359] ---[ end trace 0000000000000000 ]--- <6> [118.389361] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [118.389438] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [118.389445] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [118.389662] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [118.389902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [118.389999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [118.390098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [118.390191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [118.390282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [118.390371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [118.390459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [118.390550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [118.390638] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [118.390740] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [118.390833] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [118.391979] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [118.402764] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [118.403035] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [118.404042] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [118.404123] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [118.404199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [118.404276] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [118.404350] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [118.404423] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [118.404495] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [118.404566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [118.404636] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [118.404706] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [118.404776] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [118.404853] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [118.404930] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [118.405007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [118.405083] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [118.405160] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [118.405236] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [118.405312] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [118.405389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [118.405475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [118.405561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [118.405644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [118.405725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [118.405807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [118.405900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [118.405980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [118.406059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [118.406137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [118.406218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [118.406301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [118.406382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [118.406462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [118.406542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [118.406620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [118.406704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [118.406789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [118.406881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [118.406963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [118.407041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [118.407119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [118.407197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [118.407275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [118.407350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [118.407428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [118.407507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [118.407586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [118.407663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [118.407740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [118.407816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [118.407908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [118.407989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [118.408067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [118.408144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [118.408220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [118.408294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [118.408371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [118.408448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [118.408524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [118.408597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [118.408676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [118.408753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [118.408831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [118.408924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [118.409001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [118.409078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [118.409154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [118.409228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [118.409304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [118.409383] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [118.409503] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [118.409507] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44140, lrc_seqno=44140, guc_id=0, flags=0x73 in no process [-1] <7> [118.409510] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.409578] ------------[ cut here ]------------ <4> [118.409579] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.409581] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:5/202 <4> [118.409659] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.409727] CPU: 11 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.409730] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.409732] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.409733] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.409739] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.409815] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.409817] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [118.409819] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.409821] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.409822] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.409823] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.409824] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.409826] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [118.409827] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.409829] CR2: 00007d0de2741560 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [118.409830] PKRU: 55555554 <4> [118.409831] Call Trace: <4> [118.409832] <TASK> <4> [118.409841] ? lock_acquire+0x60/0x300 <4> [118.409847] ? lock_release+0xd0/0x2b0 <4> [118.409852] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.409859] process_one_work+0x239/0x740 <4> [118.409865] worker_thread+0x200/0x3f0 <4> [118.409868] ? __pfx_worker_thread+0x10/0x10 <4> [118.409871] kthread+0x10d/0x150 <4> [118.409873] ? __pfx_kthread+0x10/0x10 <4> [118.409876] ret_from_fork+0x3bd/0x470 <4> [118.409879] ? __pfx_kthread+0x10/0x10 <4> [118.409881] ret_from_fork_asm+0x1a/0x30 <4> [118.409889] </TASK> <4> [118.409890] irq event stamp: 1907481 <4> [118.409891] hardirqs last enabled at (1907487): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.409894] hardirqs last disabled at (1907492): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.409895] softirqs last enabled at (1906604): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.409898] softirqs last disabled at (1906597): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.409901] ---[ end trace 0000000000000000 ]--- <6> [118.410897] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [118.411086] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [118.411097] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [118.411156] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [118.411272] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [118.411382] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [118.411595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [118.411690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [118.411787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [118.411895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [118.411986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [118.412075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [118.412163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [118.412253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [118.412338] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [118.412440] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [118.412533] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [118.413570] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [118.423844] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [118.424100] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [118.425227] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [118.425314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [118.425390] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [118.425464] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [118.425537] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [118.425610] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [118.425682] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [118.425754] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [118.425826] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [118.425916] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [118.425993] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [118.426071] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [118.426148] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [118.426224] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [118.426300] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [118.426376] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [118.426453] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [118.426528] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [118.426604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [118.426691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [118.426775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [118.426866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [118.426949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [118.427030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [118.427112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [118.427194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [118.427273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [118.427351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [118.427429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [118.427507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [118.427587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [118.427665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [118.427744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [118.427822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [118.427917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [118.428001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [118.428085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [118.428166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [118.428244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [118.428322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [118.428398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [118.428474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [118.428549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [118.428627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [118.428704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [118.428782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [118.428870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [118.428949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [118.429027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [118.429121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [118.429204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [118.429283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [118.429361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [118.429439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [118.429516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [118.429596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [118.429674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [118.429750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [118.429827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [118.429927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [118.430004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [118.430080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [118.430159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [118.430237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [118.430316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [118.430394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [118.430471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [118.430547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [118.430627] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [118.430746] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [118.430750] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44140, lrc_seqno=44140, guc_id=0, flags=0x73 in no process [-1] <7> [118.430753] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.430821] ------------[ cut here ]------------ <4> [118.430822] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.430823] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:5/202 <4> [118.430918] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.430985] CPU: 1 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.430988] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.430989] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.430991] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.430997] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.431072] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.431074] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [118.431076] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.431078] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.431079] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.431081] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.431082] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.431083] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [118.431085] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.431086] CR2: 00007ad854e97000 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [118.431088] PKRU: 55555554 <4> [118.431089] Call Trace: <4> [118.431090] <TASK> <4> [118.431094] ? lock_acquire+0x60/0x300 <4> [118.431099] ? lock_release+0xd0/0x2b0 <4> [118.431104] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.431110] process_one_work+0x239/0x740 <4> [118.431117] worker_thread+0x200/0x3f0 <4> [118.431120] ? __pfx_worker_thread+0x10/0x10 <4> [118.431122] kthread+0x10d/0x150 <4> [118.431125] ? __pfx_kthread+0x10/0x10 <4> [118.431128] ret_from_fork+0x3bd/0x470 <4> [118.431130] ? __pfx_kthread+0x10/0x10 <4> [118.431132] ret_from_fork_asm+0x1a/0x30 <4> [118.431140] </TASK> <4> [118.431141] irq event stamp: 1910661 <4> [118.431143] hardirqs last enabled at (1910667): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.431145] hardirqs last disabled at (1910672): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.431146] softirqs last enabled at (1909764): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.431149] softirqs last disabled at (1909747): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.431152] ---[ end trace 0000000000000000 ]--- <5> [118.431529] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44195, lrc_seqno=44195, guc_id=0, flags=0x73 in no process [-1] <7> [118.431536] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.431912] ------------[ cut here ]------------ <4> [118.431915] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.431917] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#13: kworker/u64:2/119 <4> [118.432049] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.432156] CPU: 13 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.432160] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.432162] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.432164] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.432176] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.432301] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.432304] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [118.432307] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.432309] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.432311] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.432313] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.432315] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.432317] FS: 0000000000000000(0000) GS:ffff8888db303000(0000) knlGS:0000000000000000 <4> [118.432319] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.432321] CR2: 0000000627df37d0 CR3: 000000012c678003 CR4: 0000000000f72ef0 <4> [118.432323] PKRU: 55555554 <4> [118.432325] Call Trace: <4> [118.432326] <TASK> <4> [118.432333] ? lock_acquire+0x60/0x300 <4> [118.432342] ? lock_release+0xd0/0x2b0 <4> [118.432350] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.432362] process_one_work+0x239/0x740 <4> [118.432374] worker_thread+0x200/0x3f0 <4> [118.432379] ? __pfx_worker_thread+0x10/0x10 <4> [118.432382] kthread+0x10d/0x150 <4> [118.432386] ? __pfx_kthread+0x10/0x10 <4> [118.432391] ret_from_fork+0x3bd/0x470 <4> [118.432395] ? __pfx_kthread+0x10/0x10 <4> [118.432399] ret_from_fork_asm+0x1a/0x30 <4> [118.432412] </TASK> <4> [118.432413] irq event stamp: 1808089 <4> [118.432415] hardirqs last enabled at (1808095): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.432418] hardirqs last disabled at (1808100): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.432421] softirqs last enabled at (1806698): [<ffffffff8133ad53>] kernel_fpu_end+0x53/0x70 <4> [118.432424] softirqs last disabled at (1806696): [<ffffffff8133b464>] kernel_fpu_begin_mask+0xc4/0x120 <4> [118.432428] ---[ end trace 0000000000000000 ]--- <6> [118.432448] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [118.432562] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [118.432571] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [118.432627] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [118.432745] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [118.432867] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [118.433082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [118.433180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [118.433277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [118.433370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [118.433460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [118.433550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [118.433639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [118.433728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [118.433811] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [118.433923] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [118.434018] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [118.435055] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [118.444846] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [118.445106] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [118.446129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [118.446215] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [118.446296] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [118.446378] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [118.446456] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [118.446534] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [118.446611] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [118.446688] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [118.446764] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [118.446849] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [118.446927] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [118.447005] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [118.447082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [118.447161] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [118.447239] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [118.447317] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [118.447393] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [118.447468] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [118.447543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [118.447630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [118.447714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [118.447796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [118.447889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [118.447971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [118.448052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [118.448130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [118.448208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [118.448286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [118.448363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [118.448443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [118.448524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [118.448603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [118.448682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [118.448761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [118.448853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [118.448945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [118.449032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [118.449115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [118.449196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [118.449275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [118.449354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [118.449432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [118.449508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [118.449586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [118.449665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [118.449742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [118.449820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [118.449915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [118.449992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [118.450069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [118.450152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [118.450231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [118.450315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [118.450393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [118.450469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [118.450548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [118.450626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [118.450702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [118.450778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [118.450863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [118.450941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [118.451019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [118.451096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [118.451173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [118.451250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [118.451326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [118.451402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [118.451477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [118.451556] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [118.451675] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [118.451679] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44195, lrc_seqno=44195, guc_id=0, flags=0x73 in no process [-1] <7> [118.451681] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.451748] ------------[ cut here ]------------ <4> [118.451749] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.451750] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:5/202 <4> [118.451829] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.451906] CPU: 1 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.451909] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.451910] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.451911] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.451917] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.451992] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.451994] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [118.451996] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.451998] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.451999] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.452000] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.452001] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.452003] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [118.452004] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.452006] CR2: 00007ad854e97000 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [118.452007] PKRU: 55555554 <4> [118.452008] Call Trace: <4> [118.452009] <TASK> <4> [118.452013] ? lock_acquire+0x60/0x300 <4> [118.452018] ? lock_release+0xd0/0x2b0 <4> [118.452023] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.452029] process_one_work+0x239/0x740 <4> [118.452035] worker_thread+0x200/0x3f0 <4> [118.452039] ? __pfx_worker_thread+0x10/0x10 <4> [118.452041] kthread+0x10d/0x150 <4> [118.452043] ? __pfx_kthread+0x10/0x10 <4> [118.452046] ret_from_fork+0x3bd/0x470 <4> [118.452049] ? __pfx_kthread+0x10/0x10 <4> [118.452051] ret_from_fork_asm+0x1a/0x30 <4> [118.452059] </TASK> <4> [118.452060] irq event stamp: 1915013 <4> [118.452061] hardirqs last enabled at (1915019): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.452063] hardirqs last disabled at (1915024): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.452065] softirqs last enabled at (1914116): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.452068] softirqs last disabled at (1914109): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.452070] ---[ end trace 0000000000000000 ]--- <6> [118.452072] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [118.452146] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [118.452152] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [118.453392] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [118.453504] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [118.453614] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [118.453832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [118.453976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [118.454080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [118.454177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [118.454266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [118.454354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [118.454439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [118.454527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [118.454609] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [118.454711] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [118.454804] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [118.455854] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [118.466598] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [118.466874] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [118.467966] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [118.468050] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [118.468126] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [118.468205] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [118.468280] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [118.468354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [118.468425] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [118.468498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [118.468575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [118.468646] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [118.468716] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [118.468787] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [118.468869] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [118.468947] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [118.469024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [118.469101] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [118.469177] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [118.469253] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [118.469330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [118.469417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [118.469503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [118.469587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [118.469668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [118.469750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [118.469832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [118.469934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [118.470017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [118.470097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [118.470174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [118.470254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [118.470335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [118.470418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [118.470499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [118.470581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [118.470666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [118.470751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [118.470835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [118.470934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [118.471014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [118.471092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [118.471170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [118.471248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [118.471324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [118.471401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [118.471481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [118.471559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [118.471637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [118.471713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [118.471789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [118.471874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [118.471953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [118.472030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [118.472107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [118.472184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [118.472260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [118.472338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [118.472414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [118.472491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [118.472567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [118.472649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [118.472730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [118.472809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [118.472897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [118.472974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [118.473052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [118.473128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [118.473203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [118.473279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [118.473357] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [118.473481] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [118.473485] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44195, lrc_seqno=44195, guc_id=0, flags=0x73 in no process [-1] <7> [118.473488] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.473556] ------------[ cut here ]------------ <4> [118.473557] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.473558] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:8/1979 <4> [118.473636] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.473703] CPU: 11 UID: 0 PID: 1979 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.473706] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.473707] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.473709] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.473715] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.473801] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.473803] RSP: 0018:ffffc90001a5fca0 EFLAGS: 00010246 <4> [118.473805] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.473807] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.473808] RBP: ffffc90001a5fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.473809] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.473811] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.473812] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [118.473814] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.473815] CR2: 00007d0de2741560 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [118.473816] PKRU: 55555554 <4> [118.473818] Call Trace: <4> [118.473819] <TASK> <4> [118.473823] ? lock_acquire+0x60/0x300 <4> [118.473828] ? lock_release+0xd0/0x2b0 <4> [118.473833] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.473844] process_one_work+0x239/0x740 <4> [118.473851] worker_thread+0x200/0x3f0 <4> [118.473854] ? __pfx_worker_thread+0x10/0x10 <4> [118.473857] kthread+0x10d/0x150 <4> [118.473860] ? __pfx_kthread+0x10/0x10 <4> [118.473863] ret_from_fork+0x3bd/0x470 <4> [118.473865] ? __pfx_kthread+0x10/0x10 <4> [118.473867] ret_from_fork_asm+0x1a/0x30 <4> [118.473875] </TASK> <4> [118.473877] irq event stamp: 344067 <4> [118.473878] hardirqs last enabled at (344073): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.473880] hardirqs last disabled at (344078): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.473882] softirqs last enabled at (343018): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.473885] softirqs last disabled at (343011): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.473888] ---[ end trace 0000000000000000 ]--- <7> [118.475176] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [118.475333] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [118.475765] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44250, lrc_seqno=44250, guc_id=0, flags=0x73 in no process [-1] <7> [118.475769] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.475892] ------------[ cut here ]------------ <4> [118.475894] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.475895] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#1: kworker/u64:8/1979 <4> [118.475979] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.476045] CPU: 1 UID: 0 PID: 1979 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.476048] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.476049] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.476050] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.476056] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.476135] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.476136] RSP: 0018:ffffc90001a5fca0 EFLAGS: 00010246 <4> [118.476139] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.476140] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.476141] RBP: ffffc90001a5fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.476143] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.476144] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.476145] FS: 0000000000000000(0000) GS:ffff8888dad03000(0000) knlGS:0000000000000000 <4> [118.476147] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.476148] CR2: 00007ad854e97000 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [118.476149] PKRU: 55555554 <4> [118.476151] Call Trace: <4> [118.476152] <TASK> <4> [118.476156] ? lock_acquire+0x60/0x300 <4> [118.476161] ? lock_release+0xd0/0x2b0 <4> [118.476165] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.476171] process_one_work+0x239/0x740 <4> [118.476178] worker_thread+0x200/0x3f0 <4> [118.476181] ? __pfx_worker_thread+0x10/0x10 <4> [118.476184] kthread+0x10d/0x150 <4> [118.476186] ? __pfx_kthread+0x10/0x10 <4> [118.476189] ret_from_fork+0x3bd/0x470 <4> [118.476191] ? __pfx_kthread+0x10/0x10 <4> [118.476194] ret_from_fork_asm+0x1a/0x30 <4> [118.476201] </TASK> <4> [118.476202] irq event stamp: 346155 <4> [118.476204] hardirqs last enabled at (346161): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.476206] hardirqs last disabled at (346166): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.476207] softirqs last enabled at (345400): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.476210] softirqs last disabled at (345219): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.476213] ---[ end trace 0000000000000000 ]--- <6> [118.476215] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [118.476292] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [118.476300] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [118.476378] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [118.476654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [118.476752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [118.476860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [118.476954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [118.477047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [118.477136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [118.477223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [118.477311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [118.477394] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [118.477496] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [118.477590] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [118.478652] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [118.488846] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [118.489105] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [118.490254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [118.490358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [118.490447] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [118.490531] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [118.490613] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [118.490689] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [118.490767] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [118.490872] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [118.490949] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [118.491026] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [118.491103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [118.491179] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [118.491254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [118.491329] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [118.491404] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [118.491480] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [118.491555] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [118.491630] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [118.491707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [118.491796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [118.491896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [118.491979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [118.492058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [118.492138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [118.492217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [118.492292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [118.492369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [118.492444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [118.492520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [118.492599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [118.492678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [118.492756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [118.492834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [118.492934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [118.493024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [118.493110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [118.493195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [118.493276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [118.493357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [118.493434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [118.493514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [118.493595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [118.493672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [118.493751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [118.493831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [118.493947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [118.494026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [118.494103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [118.494181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [118.494260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [118.494340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [118.494418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [118.494495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [118.494573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [118.494649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [118.494727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [118.494803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [118.494894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [118.494971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [118.495051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [118.495130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [118.495208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [118.495285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [118.495361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [118.495439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [118.495515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [118.495590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [118.495665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [118.495744] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [118.495876] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [118.495880] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44250, lrc_seqno=44250, guc_id=0, flags=0x73 in no process [-1] <7> [118.495883] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.495951] ------------[ cut here ]------------ <4> [118.495952] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.495954] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:2/119 <4> [118.496033] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.496100] CPU: 10 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.496103] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.496104] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.496105] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.496111] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.496187] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.496189] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [118.496192] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.496193] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.496194] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.496196] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.496197] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.496198] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [118.496200] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.496201] CR2: 00007d0de11e62f4 CR3: 000000011d065005 CR4: 0000000000f72ef0 <4> [118.496202] PKRU: 55555554 <4> [118.496204] Call Trace: <4> [118.496205] <TASK> <4> [118.496209] ? lock_acquire+0x60/0x300 <4> [118.496214] ? lock_release+0xd0/0x2b0 <4> [118.496219] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.496225] process_one_work+0x239/0x740 <4> [118.496231] worker_thread+0x200/0x3f0 <4> [118.496235] ? __pfx_worker_thread+0x10/0x10 <4> [118.496237] kthread+0x10d/0x150 <4> [118.496240] ? __pfx_kthread+0x10/0x10 <4> [118.496243] ret_from_fork+0x3bd/0x470 <4> [118.496245] ? __pfx_kthread+0x10/0x10 <4> [118.496247] ret_from_fork_asm+0x1a/0x30 <4> [118.496255] </TASK> <4> [118.496256] irq event stamp: 1811745 <4> [118.496257] hardirqs last enabled at (1811751): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.496260] hardirqs last disabled at (1811756): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.496261] softirqs last enabled at (1810836): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.496264] softirqs last disabled at (1810829): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.496267] ---[ end trace 0000000000000000 ]--- <6> [118.496269] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [118.496346] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [118.496352] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [118.497474] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [118.497587] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [118.497698] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [118.497924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [118.498026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [118.498129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [118.498224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [118.498316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [118.498407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [118.498497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [118.498591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [118.498678] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [118.498780] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [118.498898] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [118.499934] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [118.509849] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [118.510107] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [118.511133] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [118.511218] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [118.511299] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [118.511379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [118.511459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [118.511540] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [118.511620] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [118.511699] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [118.511776] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [118.511865] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [118.511942] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [118.512018] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [118.512094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [118.512171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [118.512246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [118.512323] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [118.512398] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [118.512474] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [118.512549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [118.512635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [118.512720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [118.512806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [118.512896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [118.512977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [118.513058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [118.513137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [118.513216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [118.513294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [118.513371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [118.513452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [118.513533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [118.513612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [118.513692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [118.513772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [118.513860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [118.513968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [118.514053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [118.514134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [118.514214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [118.514291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [118.514371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [118.514448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [118.514524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [118.514601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [118.514681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [118.514759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [118.514844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [118.514922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [118.514998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [118.515076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [118.515155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [118.515232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [118.515310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [118.515388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [118.515465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [118.515543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [118.515622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [118.515699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [118.515775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [118.515857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [118.515935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [118.516013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [118.516090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [118.516166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [118.516243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [118.516319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [118.516394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [118.516469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [118.516548] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [118.516667] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [118.516671] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44250, lrc_seqno=44250, guc_id=0, flags=0x73 in no process [-1] <7> [118.516674] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.516741] ------------[ cut here ]------------ <4> [118.516743] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.516744] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#6: kworker/u64:5/202 <4> [118.516834] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.516905] CPU: 6 UID: 0 PID: 202 Comm: kworker/u64:5 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.516908] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.516910] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.516911] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.516917] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.516994] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.516996] RSP: 0018:ffffc90001617ca0 EFLAGS: 00010246 <4> [118.516999] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.517000] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.517001] RBP: ffffc90001617db0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.517003] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.517004] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.517005] FS: 0000000000000000(0000) GS:ffff8888daf83000(0000) knlGS:0000000000000000 <4> [118.517007] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.517008] CR2: 00007ad854e98000 CR3: 000000012c678001 CR4: 0000000000f72ef0 <4> [118.517010] PKRU: 55555554 <4> [118.517011] Call Trace: <4> [118.517012] <TASK> <4> [118.517016] ? lock_acquire+0x60/0x300 <4> [118.517022] ? lock_release+0xd0/0x2b0 <4> [118.517026] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.517032] process_one_work+0x239/0x740 <4> [118.517039] worker_thread+0x200/0x3f0 <4> [118.517042] ? __pfx_worker_thread+0x10/0x10 <4> [118.517045] kthread+0x10d/0x150 <4> [118.517047] ? __pfx_kthread+0x10/0x10 <4> [118.517050] ret_from_fork+0x3bd/0x470 <4> [118.517052] ? __pfx_kthread+0x10/0x10 <4> [118.517055] ret_from_fork_asm+0x1a/0x30 <4> [118.517063] </TASK> <4> [118.517064] irq event stamp: 1919497 <4> [118.517065] hardirqs last enabled at (1919503): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.517067] hardirqs last disabled at (1919508): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.517069] softirqs last enabled at (1918780): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.517072] softirqs last disabled at (1918775): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.517074] ---[ end trace 0000000000000000 ]--- <7> [118.518260] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <5> [118.518347] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44305, lrc_seqno=44305, guc_id=0, flags=0x73 in no process [-1] <7> [118.518351] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <7> [118.518376] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [118.518426] ------------[ cut here ]------------ <4> [118.518428] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.518429] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:8/1979 <4> [118.518514] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.518592] CPU: 11 UID: 0 PID: 1979 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.518596] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.518597] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.518599] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.518605] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.518684] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.518686] RSP: 0018:ffffc90001a5fca0 EFLAGS: 00010246 <4> [118.518689] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.518690] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.518692] RBP: ffffc90001a5fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.518693] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.518694] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.518695] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [118.518697] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.518698] CR2: 00007d0de2741560 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [118.518700] PKRU: 55555554 <4> [118.518701] Call Trace: <4> [118.518702] <TASK> <4> [118.518706] ? lock_acquire+0x60/0x300 <4> [118.518711] ? lock_release+0xd0/0x2b0 <4> [118.518716] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.518722] process_one_work+0x239/0x740 <4> [118.518729] worker_thread+0x200/0x3f0 <4> [118.518732] ? __pfx_worker_thread+0x10/0x10 <4> [118.518735] kthread+0x10d/0x150 <4> [118.518737] ? __pfx_kthread+0x10/0x10 <4> [118.518740] ret_from_fork+0x3bd/0x470 <4> [118.518742] ? __pfx_kthread+0x10/0x10 <4> [118.518745] ret_from_fork_asm+0x1a/0x30 <4> [118.518752] </TASK> <4> [118.518754] irq event stamp: 348261 <4> [118.518755] hardirqs last enabled at (348267): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.518757] hardirqs last disabled at (348272): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.518759] softirqs last enabled at (347006): [<ffffffff8133ad53>] kernel_fpu_end+0x53/0x70 <4> [118.518761] softirqs last disabled at (347004): [<ffffffff8133b464>] kernel_fpu_begin_mask+0xc4/0x120 <4> [118.518764] ---[ end trace 0000000000000000 ]--- <6> [118.518766] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [118.518855] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [118.518862] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [118.519094] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [118.519341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [118.519439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [118.519538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [118.519632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [118.519726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [118.519815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [118.519919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [118.520012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [118.520097] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [118.520198] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [118.520292] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [118.521332] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [118.532063] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [118.532322] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [118.533356] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [118.533442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [118.533524] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [118.533606] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [118.533685] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [118.533762] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [118.533848] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [118.533926] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [118.534002] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [118.534079] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [118.534155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [118.534231] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [118.534308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [118.534383] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [118.534459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [118.534534] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [118.534610] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [118.534686] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [118.534764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [118.534857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [118.534940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [118.535022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [118.535101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [118.535184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [118.535264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [118.535341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [118.535418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [118.535495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [118.535573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [118.535652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [118.535732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [118.535811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [118.535901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [118.535979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [118.536063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [118.536146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [118.536228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [118.536309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [118.536387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [118.536465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [118.536541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [118.536618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [118.536693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [118.536770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [118.536856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [118.536943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [118.537025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [118.537110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [118.537191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [118.537272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [118.537354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [118.537432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [118.537511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [118.537589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [118.537664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [118.537742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [118.537820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [118.537910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [118.537985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [118.538065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [118.538141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [118.538217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [118.538295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [118.538371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [118.538448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [118.538525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [118.538600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [118.538676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [118.538754] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [118.538883] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [118.538887] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44305, lrc_seqno=44305, guc_id=0, flags=0x73 in no process [-1] <7> [118.538889] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.538959] ------------[ cut here ]------------ <4> [118.538960] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.538961] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:8/1979 <4> [118.539040] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.539105] CPU: 11 UID: 0 PID: 1979 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.539108] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.539109] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.539111] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.539117] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.539193] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.539195] RSP: 0018:ffffc90001a5fca0 EFLAGS: 00010246 <4> [118.539197] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.539198] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.539200] RBP: ffffc90001a5fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.539201] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.539202] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.539204] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [118.539205] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.539206] CR2: 00007d0de2741560 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [118.539208] PKRU: 55555554 <4> [118.539209] Call Trace: <4> [118.539210] <TASK> <4> [118.539214] ? lock_acquire+0x60/0x300 <4> [118.539219] ? lock_release+0xd0/0x2b0 <4> [118.539224] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.539230] process_one_work+0x239/0x740 <4> [118.539236] worker_thread+0x200/0x3f0 <4> [118.539239] ? __pfx_worker_thread+0x10/0x10 <4> [118.539242] kthread+0x10d/0x150 <4> [118.539244] ? __pfx_kthread+0x10/0x10 <4> [118.539247] ret_from_fork+0x3bd/0x470 <4> [118.539249] ? __pfx_kthread+0x10/0x10 <4> [118.539252] ret_from_fork_asm+0x1a/0x30 <4> [118.539260] </TASK> <4> [118.539261] irq event stamp: 351443 <4> [118.539262] hardirqs last enabled at (351449): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.539264] hardirqs last disabled at (351454): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.539266] softirqs last enabled at (350446): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.539269] softirqs last disabled at (350439): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.539271] ---[ end trace 0000000000000000 ]--- <6> [118.539273] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [118.539349] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [118.539356] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [118.540613] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [118.540725] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [118.540843] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [118.541072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [118.541165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [118.541260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [118.541348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [118.541434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [118.541517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [118.541605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [118.541693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [118.541776] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [118.541884] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [118.541979] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [118.543013] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [118.553743] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [118.553999] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [118.555044] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [118.555129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [118.555210] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [118.555290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [118.555371] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [118.555451] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [118.555529] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [118.555606] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [118.555682] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [118.555756] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [118.555832] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [118.555925] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [118.556001] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [118.556076] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [118.556152] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [118.556227] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [118.556302] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [118.556376] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [118.556451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [118.556537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [118.556623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [118.556703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [118.556783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [118.556874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [118.556955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [118.557032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [118.557110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [118.557186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [118.557262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [118.557342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [118.557422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [118.557500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [118.557580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [118.557659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [118.557744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [118.557828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [118.557927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [118.558009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [118.558088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [118.558166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [118.558244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [118.558320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [118.558395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [118.558472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [118.558549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [118.558627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [118.558703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [118.558780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [118.558861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [118.558940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [118.559020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [118.559096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [118.559174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [118.559249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [118.559325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [118.559401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [118.559479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [118.559553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [118.559629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [118.559707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [118.559783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [118.559881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [118.559966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [118.560047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [118.560125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [118.560203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [118.560278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [118.560356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [118.560434] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [118.560558] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [118.560562] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44305, lrc_seqno=44305, guc_id=0, flags=0x73 in no process [-1] <7> [118.560565] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.560632] ------------[ cut here ]------------ <4> [118.560633] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.560634] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#10: kworker/u64:2/119 <4> [118.560713] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.560782] CPU: 10 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.560785] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.560786] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.560788] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.560793] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.560880] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.560882] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [118.560885] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.560887] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.560888] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.560889] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.560891] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.560893] FS: 0000000000000000(0000) GS:ffff8888db183000(0000) knlGS:0000000000000000 <4> [118.560894] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.560896] CR2: 00007d0de11e62f4 CR3: 000000000344a003 CR4: 0000000000f72ef0 <4> [118.560898] PKRU: 55555554 <4> [118.560899] Call Trace: <4> [118.560900] <TASK> <4> [118.560904] ? lock_acquire+0x60/0x300 <4> [118.560909] ? lock_release+0xd0/0x2b0 <4> [118.560914] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.560921] process_one_work+0x239/0x740 <4> [118.560928] worker_thread+0x200/0x3f0 <4> [118.560931] ? __pfx_worker_thread+0x10/0x10 <4> [118.560934] kthread+0x10d/0x150 <4> [118.560936] ? __pfx_kthread+0x10/0x10 <4> [118.560939] ret_from_fork+0x3bd/0x470 <4> [118.560941] ? __pfx_kthread+0x10/0x10 <4> [118.560944] ret_from_fork_asm+0x1a/0x30 <4> [118.560952] </TASK> <4> [118.560953] irq event stamp: 1818549 <4> [118.560955] hardirqs last enabled at (1818555): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.560957] hardirqs last disabled at (1818560): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.560959] softirqs last enabled at (1817666): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.560962] softirqs last disabled at (1817655): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.560965] ---[ end trace 0000000000000000 ]--- <7> [118.561990] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [118.562101] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [118.562290] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44360, lrc_seqno=44360, guc_id=0, flags=0x73 in no process [-1] <7> [118.562294] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.562370] ------------[ cut here ]------------ <4> [118.562372] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.562373] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#8: kworker/u64:2/119 <4> [118.562457] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.562526] CPU: 8 UID: 0 PID: 119 Comm: kworker/u64:2 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.562529] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.562530] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.562532] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.562538] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.562617] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.562619] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246 <4> [118.562621] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.562623] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.562624] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.562625] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.562626] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.562627] FS: 0000000000000000(0000) GS:ffff8888db083000(0000) knlGS:0000000000000000 <4> [118.562629] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.562630] CR2: 00007ad854e99000 CR3: 000000000344a001 CR4: 0000000000f72ef0 <4> [118.562632] PKRU: 55555554 <4> [118.562633] Call Trace: <4> [118.562634] <TASK> <4> [118.562638] ? lock_acquire+0x60/0x300 <4> [118.562643] ? lock_release+0xd0/0x2b0 <4> [118.562648] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.562655] process_one_work+0x239/0x740 <4> [118.562661] worker_thread+0x200/0x3f0 <4> [118.562664] ? __pfx_worker_thread+0x10/0x10 <4> [118.562667] kthread+0x10d/0x150 <4> [118.562669] ? __pfx_kthread+0x10/0x10 <4> [118.562672] ret_from_fork+0x3bd/0x470 <4> [118.562675] ? __pfx_kthread+0x10/0x10 <4> [118.562677] ret_from_fork_asm+0x1a/0x30 <4> [118.562685] </TASK> <4> [118.562686] irq event stamp: 1820457 <4> [118.562687] hardirqs last enabled at (1820463): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.562689] hardirqs last disabled at (1820468): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.562691] softirqs last enabled at (1818612): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.562694] softirqs last disabled at (1818593): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.562696] ---[ end trace 0000000000000000 ]--- <6> [118.562698] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [118.562776] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [118.562782] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [118.562870] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [118.563082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [118.563177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [118.563271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [118.563360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [118.563447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [118.563531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [118.563618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [118.563704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [118.563786] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [118.563897] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [118.563990] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [118.565026] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [118.574848] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [118.575131] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [118.576185] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [118.576270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [118.576350] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [118.576432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [118.576511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [118.576590] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [118.576669] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [118.576751] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [118.576830] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [118.576929] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [118.577006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [118.577084] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [118.577164] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [118.577243] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [118.577318] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [118.577395] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [118.577470] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [118.577546] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [118.577621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [118.577707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [118.577791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2098] = 0xffffffff <7> [118.577889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [118.577969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [118.578049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x229c] = 0x00080008 <7> [118.578128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [118.578205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [118.578283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [118.578359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [118.578436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [118.578516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [118.578596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [118.578675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [118.578753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [118.578831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [118.578947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [118.579032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [118.579116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [118.579195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00030003 <7> [118.579275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [118.579352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [118.579428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22098] = 0xffffffff <7> [118.579505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [118.579581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [118.579658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2229c] = 0x00080008 <7> [118.579736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [118.579814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [118.579899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee098] = 0xffffffff <7> [118.579975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [118.580051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [118.580128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee29c] = 0x00080008 <7> [118.580207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [118.580284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [118.580361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a098] = 0xffffffff <7> [118.580437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [118.580512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [118.580588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a29c] = 0x00080008 <7> [118.580664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [118.580738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [118.580813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [118.580901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [118.580984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [118.581063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c098] = 0xffffffff <7> [118.581140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [118.581216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [118.581292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c29c] = 0x00080008 <7> [118.581368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [118.581442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [118.581515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [118.581595] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [118.581715] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [118.581719] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=44360, lrc_seqno=44360, guc_id=0, flags=0x73 in no process [-1] <7> [118.581721] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [118.582650] ------------[ cut here ]------------ <4> [118.582652] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [118.582653] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1618 at guc_exec_queue_timedout_job+0x141a/0x2400 [xe], CPU#11: kworker/u64:8/1979 <4> [118.582744] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [118.582811] CPU: 11 UID: 0 PID: 1979 Comm: kworker/u64:8 Tainted: G S U W 7.1.0-rc3-lgci-xe-xe-5041-f8ee23694aa6be213-debug+ #1 PREEMPT(lazy) <4> [118.582814] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN <4> [118.582815] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [118.582817] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [118.582822] RIP: 0010:guc_exec_queue_timedout_job+0x1423/0x2400 [xe] <4> [118.582911] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49 <4> [118.582913] RSP: 0018:ffffc90001a5fca0 EFLAGS: 00010246 <4> [118.582916] RAX: ffffffffa12bbe79 RBX: 0000000000000000 RCX: 0000000000000000 <4> [118.582917] RDX: ffff888101c23f90 RSI: ffffffffa12bbe79 RDI: ffffffffa0c03f80 <4> [118.582919] RBP: ffffc90001a5fdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [118.582920] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [118.582922] R13: ffff888101c23f90 R14: ffff888131fea018 R15: 00000000ffffffc2 <4> [118.582923] FS: 0000000000000000(0000) GS:ffff8888db203000(0000) knlGS:0000000000000000 <4> [118.582925] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [118.582927] CR2: 00007d0de2741560 CR3: 000000000344a004 CR4: 0000000000f72ef0 <4> [118.582928] PKRU: 55555554 <4> [118.582929] Call Trace: <4> [118.582931] <TASK> <4> [118.582935] ? lock_acquire+0x60/0x300 <4> [118.582940] ? lock_release+0xd0/0x2b0 <4> [118.582944] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [118.582951] process_one_work+0x239/0x740 <4> [118.582958] worker_thread+0x200/0x3f0 <4> [118.582961] ? __pfx_worker_thread+0x10/0x10 <4> [118.582964] kthread+0x10d/0x150 <4> [118.582966] ? __pfx_kthread+0x10/0x10 <4> [118.582969] ret_from_fork+0x3bd/0x470 <4> [118.582971] ? __pfx_kthread+0x10/0x10 <4> [118.582974] ret_from_fork_asm+0x1a/0x30 <4> [118.582982] </TASK> <4> [118.582983] irq event stamp: 354923 <4> [118.582985] hardirqs last enabled at (354929): [<ffffffff814ab359>] __up_console_sem+0x79/0xa0 <4> [118.582987] hardirqs last disabled at (354934): [<ffffffff814ab33e>] __up_console_sem+0x5e/0xa0 <4> [118.582988] softirqs last enabled at (354762): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.582991] softirqs last disabled at (354751): [<ffffffff813d230b>] __irq_exit_rcu+0xdb/0x1c0 <4> [118.582994] ---[ end trace 0000000000000000 ]--- <6> [118.582996] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [118.583071] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [118.583077] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [118.583092] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [118.583202] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [118.583482] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [118.583693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [118.583792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [118.583900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [118.583990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [118.584076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [118.584162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [118.584247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [118.584333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [118.584415] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [118.584516] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [118.584610] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [118.585644] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [118.595845] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [118.596102] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [118.597130] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [118.597217] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [118.597299] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [118.597377] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [118.597454] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130

<4> [117.170473] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.170650] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.192671] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.192980] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.213809] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.214081] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.215707] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.215970] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.236324] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.236503] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.258285] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.258444] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.259884] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.260040] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.280181] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.280338] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.302118] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.302274] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.303725] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.303907] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.324160] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.324317] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.346182] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.346336] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.347978] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.348136] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.368043] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.368196] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.388904] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.389063] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.390514] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake

<4> [117.390673] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.410716] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.410882] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.431750] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.431920] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.433875] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.434033] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.453784] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.453941] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.475180] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.475340] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.477059] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.477417] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.497655] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.497811] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.518910] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.519069] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.521170] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.521325] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.540793] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.540959] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.563151] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.563311] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.563918] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.564074] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.584125] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.584277] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.604824] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.604985] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.606610] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.606767] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.627277] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.627436] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.647859] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.648014] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.649068] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.649245] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.669452] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.669603] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.690777] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.690937] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.692393] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.692546] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.712969] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.713120] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.733499] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.733651] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.735402] mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.735559] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.755920] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.756075] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.776817] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.776975] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.778530] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.778686] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.799295] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.799451] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.820728] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.820897] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.822762] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.822938] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.847789] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.847946] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.868966] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.869120] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.870422] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.870651] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.891006] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.891161] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.913069] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.913224] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.914629] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.914777] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.934811] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.934968] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.956012] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.956168] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.957480] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.957642] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.976797] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.976955] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.997765] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.997925] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [117.999780] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [117.999989] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.019794] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.020201] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.041270] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.041621] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.042436] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.042595] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.061299] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.061440] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.083007] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.083161] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.084943] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.085094] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.104818] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.104982] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.125820] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.125979] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.127566] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.127717] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.149238] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.149397] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.170889] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.171043] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.172464] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.172615] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.193103] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.193272] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.215467] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.215811] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.216613] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.216861] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.236835] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.237044] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.257755] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.257929] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.259570] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.259742] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.279962] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.280116] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.300881] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.301035] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.302775] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.303020] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.322907] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.323065] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.344691] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.344853] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.345596] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.345756] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.365902] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.366059] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.387119] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.387272] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.389128] mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.389281] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.409659] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.409815] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.430918] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.431072] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.432049] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.432301] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.451829] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.451992] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.473636] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.473801] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.475979] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.476135] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.496033] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.496187] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.516834] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.516994] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.518514] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.518684] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.539040] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.539193] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.560713] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.560880] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.562457] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.562617] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

<4> [118.582744] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy gpu_sched drm_ttm_helper ttm drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling cmdlinepart x86_pkg_temp_thermal intel_powerclamp spi_nor hid_generic mtd coretemp binfmt_misc asus_nb_wmi asus_wmi sparse_keymap mei_pxp mei_hdcp wmi_bmof kvm_intel kvm irqbypass aesni_intel r8169 gf128mul usbhid rapl hid spi_intel_pci intel_cstate realtek spi_intel video phy_package nls_iso8859_1 snd_hda_intel snd_intel_dspcfg intel_pmc_core snd_hda_codec snd_hda_core pmt_telemetry snd_hwdep pmt_discovery snd_pcm snd_timer pmt_class pinctrl_alderlake intel_pmc_ssram_telemetry acpi_pad acpi_tad i2c_i801 idma64 snd i2c_mux mei_me i2c_smbus soundcore mei wmi intel_vsec dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [118.582911] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 20 d2 3c e1 48 89 c6 48 8d 3d b6 8d d9 ff 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 d0 ee ff ff 8b 70 08 49

Results for igt@xe_pat@pt-caching