igt@xe_pat@pt-caching on shard-bmg@xe-4857-87b52c2ff4f00eff41866d728f82d2b109c397f7 Test details

Detail	Value
Duration	unknown
Hostname	shard-bmg-1
Igt-Version	IGT-Version: 2.4-g2a9f1c1ae (x86_64) (Linux: 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ x86_64)
Out	Using IGT_SRANDOM=1775572387 for randomisation Opened device: /dev/dri/card0 Test requirement not met in function __igt_unique____real_main2210, file ../tests/intel/xe_pat.c:2298: Test requirement: intel_graphics_ver(dev_id) == IP_VER(35, 10) Last errno: 2, No such file or directory Starting subtest: pt-caching va_bits: 48, num_objs: 16384, spread over pt levels: [0]: 16384 [1]: 512 [2]: 16 Subtest pt-caching: SUCCESS (12.322s) This test caused an abort condition: Kernel badly tainted (0x4244, 0x200) (check dmesg for details): TAINT_WARN: WARN_ON has happened.
Err	Starting subtest: pt-caching Subtest pt-caching: SUCCESS (12.322s)
Dmesg Scroll to first warning	<6> [231.547815] Console: switching to colour dummy device 80x25 <6> [231.548147] [IGT] xe_pat: executing <6> [231.557227] [IGT] xe_pat: starting subtest pt-caching <6> [232.970208] xe 0000:03:00.0: [drm] Tile0: GT0: ASID: 0 Faulted Address: 0x0000d86700000000 FaultType: 0 AccessType: 1 FaultLevel: 3 EngineClass: 3 bcs EngineInstance: 8 <6> [232.970224] xe 0000:03:00.0: [drm] Tile0: GT0: Fault response: Unsuccessful -EINVAL <6> [232.970312] xe 0000:03:00.0: [drm] Tile0: GT0: Engine memory CAT error [18]: class=bcs, logical_mask: 0x2, guc_id=0 <6> [232.971075] xe 0000:03:00.0: [drm] Tile0: GT0: Engine reset: engine_class=bcs, logical_mask: 0x2, guc_id=0, state=0x249 <5> [232.971111] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=55545, lrc_seqno=55545, guc_id=0, flags=0x73 in no process [-1] <7> [232.971115] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.971209] ------------[ cut here ]------------ <4> [232.971210] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.971212] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:42/3216 <4> [232.971286] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [232.971364] efi_pstore nfnetlink autofs4 <4> [232.971369] CPU: 0 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [232.971373] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [L]=SOFTLOCKUP <4> [232.971374] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.971376] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.971382] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [232.971454] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [232.971456] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [232.971459] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.971460] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [232.971462] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.971463] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.971464] R13: ffff8881040ad290 R14: ffff888129e30000 R15: 00000000fffffffb <4> [232.971466] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [232.971467] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.971469] CR2: 0000738bc2804ff8 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [232.971470] PKRU: 55555554 <4> [232.971472] Call Trace: <4> [232.971473] <TASK> <4> [232.971475] ? trace_hardirqs_on+0x22/0x100 <4> [232.971481] ? lock_sync+0x100/0x100 <4> [232.971485] ? __pfx_autoremove_wake_function+0x10/0x10 <4> [232.971490] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.971496] process_one_work+0x239/0x760 <4> [232.971502] worker_thread+0x200/0x3f0 <4> [232.971505] ? __pfx_worker_thread+0x10/0x10 <4> [232.971507] kthread+0x10d/0x150 <4> [232.971510] ? __pfx_kthread+0x10/0x10 <4> [232.971514] ret_from_fork+0x3d4/0x480 <4> [232.971517] ? __pfx_kthread+0x10/0x10 <4> [232.971520] ret_from_fork_asm+0x1a/0x30 <4> [232.971527] </TASK> <4> [232.971528] irq event stamp: 1227847 <4> [232.971529] hardirqs last enabled at (1227853): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [232.971532] hardirqs last disabled at (1227858): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [232.971535] softirqs last enabled at (1226104): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [232.971537] softirqs last disabled at (1226099): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [232.971539] ---[ end trace 0000000000000000 ]--- <6> [232.971541] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [232.971608] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [232.971666] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [232.971874] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [232.972630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [232.972753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [232.972877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [232.972996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [232.973136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [232.973257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [232.973377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [232.973493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [232.973606] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [232.973729] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [232.973874] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [232.974981] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [232.985121] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [232.985387] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [232.986980] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [232.987072] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [232.987187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [232.987275] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [232.987353] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [232.987430] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [232.987508] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [232.987585] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [232.987660] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [232.987733] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [232.987807] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [232.987881] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [232.987954] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [232.988027] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [232.988115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [232.988228] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [232.988343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [232.988455] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [232.988569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [232.988686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [232.988803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [232.988917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [232.989035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [232.989171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [232.989288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [232.989402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [232.989517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [232.989634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [232.989753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [232.989867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [232.989982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [232.990112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [232.990316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [232.990462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [232.990595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [232.990724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [232.990851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [232.990975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [232.991109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [232.991231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [232.991357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [232.991481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [232.991604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [232.991726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [232.991853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [232.991976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [232.992114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [232.992215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [232.992307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [232.992395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [232.992482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [232.992572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [232.992659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [232.992743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [232.992824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [232.992907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [232.992988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [232.993067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [232.993166] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [232.993707] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [232.993713] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=55545, lrc_seqno=55545, guc_id=0, flags=0x73 in no process [-1] <7> [232.993716] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [232.993778] ------------[ cut here ]------------ <4> [232.993779] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [232.993781] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:48/3222 <4> [232.993855] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [232.993923] efi_pstore nfnetlink autofs4 <4> [232.993928] CPU: 6 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [232.993931] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [232.993932] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [232.993934] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [232.993939] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [232.994013] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [232.994014] RSP: 0000:ffffc9000716bca0 EFLAGS: 00010246 <4> [232.994017] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [232.994018] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [232.994020] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [232.994021] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [232.994022] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [232.994023] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [232.994025] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [232.994026] CR2: 000070b5c59ed910 CR3: 0000000130336003 CR4: 0000000000f72ef0 <4> [232.994028] PKRU: 55555554 <4> [232.994029] Call Trace: <4> [232.994030] <TASK> <4> [232.994034] ? lock_sync+0x100/0x100 <4> [232.994039] ? lock_release+0xd0/0x2b0 <4> [232.994045] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [232.994051] process_one_work+0x239/0x760 <4> [232.994057] worker_thread+0x200/0x3f0 <4> [232.994060] ? __pfx_worker_thread+0x10/0x10 <4> [232.994062] kthread+0x10d/0x150 <4> [232.994065] ? __pfx_kthread+0x10/0x10 <4> [232.994069] ret_from_fork+0x3d4/0x480 <4> [232.994076] ? __pfx_kthread+0x10/0x10 <4> [232.994080] ret_from_fork_asm+0x1a/0x30 <4> [232.994088] </TASK> <4> [232.994089] irq event stamp: 316059 <4> [232.994090] hardirqs last enabled at (316065): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [232.994094] hardirqs last disabled at (316070): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [232.994097] softirqs last enabled at (315214): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [232.994101] softirqs last disabled at (315209): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [232.994105] ---[ end trace 0000000000000000 ]--- <6> [232.994108] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [232.994196] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [232.994204] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [232.995188] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [232.995302] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [232.995507] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [232.995716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [232.995807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [232.995900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [232.995990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [232.996084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [232.996170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [232.996255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [232.996340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [232.996421] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [232.996515] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [232.996632] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [232.997645] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.008091] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.008343] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.009344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.009427] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.009503] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.009581] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.009660] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.009736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.009810] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.009883] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.009958] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.010035] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.010123] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.010200] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.010277] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.010352] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.010427] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.010502] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.010576] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.010649] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.010723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.010804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.010885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.010965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.011046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.011138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.011216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.011292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.011368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.011446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.011524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.011602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.011681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.011759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.011843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.011927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.012012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.012099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.012182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.012260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.012338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.012416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.012498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.012578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.012655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.012732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.012812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.012889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.012968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.013049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.013140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.013219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.013296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.013375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.013452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.013529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.013603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.013678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.013752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.013827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.013906] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.014158] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.014163] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=55545, lrc_seqno=55545, guc_id=0, flags=0x73 in no process [-1] <7> [233.014165] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.014229] ------------[ cut here ]------------ <4> [233.014230] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.014231] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:47/3221 <4> [233.014314] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.014389] efi_pstore nfnetlink autofs4 <4> [233.014394] CPU: 7 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.014397] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.014398] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.014400] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.014406] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.014477] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.014479] RSP: 0018:ffffc90007163ca0 EFLAGS: 00010246 <4> [233.014481] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.014483] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.014484] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.014485] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.014486] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.014488] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000 <4> [233.014489] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.014491] CR2: 0000738bc0802898 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [233.014492] PKRU: 55555554 <4> [233.014493] Call Trace: <4> [233.014494] <TASK> <4> [233.014499] ? lock_sync+0x100/0x100 <4> [233.014504] ? lock_release+0xd0/0x2b0 <4> [233.014510] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.014515] process_one_work+0x239/0x760 <4> [233.014522] worker_thread+0x200/0x3f0 <4> [233.014525] ? __pfx_worker_thread+0x10/0x10 <4> [233.014527] kthread+0x10d/0x150 <4> [233.014531] ? __pfx_kthread+0x10/0x10 <4> [233.014534] ret_from_fork+0x3d4/0x480 <4> [233.014537] ? __pfx_kthread+0x10/0x10 <4> [233.014540] ret_from_fork_asm+0x1a/0x30 <4> [233.014548] </TASK> <4> [233.014549] irq event stamp: 393741 <4> [233.014550] hardirqs last enabled at (393747): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.014553] hardirqs last disabled at (393752): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.014556] softirqs last enabled at (392912): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.014559] softirqs last disabled at (392905): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.014561] ---[ end trace 0000000000000000 ]--- <5> [233.016112] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=55600, lrc_seqno=55600, guc_id=0, flags=0x73 in no process [-1] <7> [233.016121] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.016283] ------------[ cut here ]------------ <4> [233.016285] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.016287] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:47/3221 <4> [233.016386] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.016496] efi_pstore nfnetlink autofs4 <4> [233.016502] CPU: 6 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.016505] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.016506] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.016508] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.016513] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.016584] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.016587] RSP: 0000:ffffc90007163ca0 EFLAGS: 00010246 <4> [233.016591] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.016593] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.016595] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.016598] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.016600] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.016602] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [233.016605] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.016607] CR2: 000070b5c59ed910 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [233.016609] PKRU: 55555554 <4> [233.016611] Call Trace: <4> [233.016613] <TASK> <4> [233.016620] ? lock_sync+0x100/0x100 <4> [233.016627] ? lock_release+0xd0/0x2b0 <4> [233.016635] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.016645] process_one_work+0x239/0x760 <4> [233.016656] worker_thread+0x200/0x3f0 <4> [233.016661] ? __pfx_worker_thread+0x10/0x10 <4> [233.016665] kthread+0x10d/0x150 <4> [233.016669] ? __pfx_kthread+0x10/0x10 <4> [233.016675] ret_from_fork+0x3d4/0x480 <7> [233.016604] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [233.016678] ? __pfx_kthread+0x10/0x10 <4> [233.016683] ret_from_fork_asm+0x1a/0x30 <4> [233.016695] </TASK> <4> [233.016697] irq event stamp: 396555 <4> [233.016698] hardirqs last enabled at (396561): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.016702] hardirqs last disabled at (396566): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.016704] softirqs last enabled at (392912): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.016707] softirqs last disabled at (392905): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.016710] ---[ end trace 0000000000000000 ]--- <6> [233.016712] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.016828] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <7> [233.016762] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [233.016838] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.016928] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.017258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.017349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.017442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.017531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.017617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.017702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.017786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.017872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.017952] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.018048] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.018180] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.019192] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.029918] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.030171] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.031320] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.031403] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.031480] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.031554] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.031630] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.031705] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.031779] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.031853] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.031927] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.032000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.032074] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.032162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.032240] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.032317] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.032392] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.032466] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.032539] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.032613] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.032686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.032768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.032848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.032927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.033007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.033089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.033182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.033262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.033340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.033419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.033499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.033577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.033653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.033731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.033813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.033896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.033982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.034064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.034153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.034231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.034309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.034385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.034463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.034541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.034616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.034691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.034770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.034846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.034924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.035000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.035077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.035160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.035240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.035320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.035398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.035475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.035551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.035628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.035704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.035780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.035859] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.035972] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.035976] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=55600, lrc_seqno=55600, guc_id=0, flags=0x73 in no process [-1] <7> [233.035979] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.036037] ------------[ cut here ]------------ <4> [233.036038] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.036039] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:47/3221 <4> [233.036112] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.036178] efi_pstore nfnetlink autofs4 <4> [233.036183] CPU: 6 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.036186] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.036188] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.036189] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.036194] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.036264] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.036265] RSP: 0000:ffffc90007163ca0 EFLAGS: 00010246 <4> [233.036268] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.036269] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.036270] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.036271] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.036273] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.036274] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [233.036275] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.036277] CR2: 000070b5c59ed910 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [233.036278] PKRU: 55555554 <4> [233.036280] Call Trace: <4> [233.036281] <TASK> <4> [233.036284] ? lock_sync+0x100/0x100 <4> [233.036289] ? lock_release+0xd0/0x2b0 <4> [233.036295] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.036300] process_one_work+0x239/0x760 <4> [233.036307] worker_thread+0x200/0x3f0 <4> [233.036309] ? __pfx_worker_thread+0x10/0x10 <4> [233.036312] kthread+0x10d/0x150 <4> [233.036315] ? __pfx_kthread+0x10/0x10 <4> [233.036318] ret_from_fork+0x3d4/0x480 <4> [233.036321] ? __pfx_kthread+0x10/0x10 <4> [233.036324] ret_from_fork_asm+0x1a/0x30 <4> [233.036331] </TASK> <4> [233.036332] irq event stamp: 399657 <4> [233.036333] hardirqs last enabled at (399663): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.036336] hardirqs last disabled at (399668): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.036338] softirqs last enabled at (398566): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.036341] softirqs last disabled at (398559): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.036344] ---[ end trace 0000000000000000 ]--- <6> [233.036345] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.036414] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.036421] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.036805] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.037007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.037090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.037193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.037280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.037366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.037450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.037535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.037621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.037702] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.037795] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.037912] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.038919] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.049463] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.049706] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.050673] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.050745] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.050814] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.050885] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.050954] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.051025] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.051094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.051174] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.051250] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.051324] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.051397] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.051470] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.051543] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.051617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.051690] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.051764] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.051839] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.051912] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.051989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.052073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.052163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.052243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.052323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.052400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.052476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.052553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.052630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.052709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.052794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.052877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.052957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.053035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.053124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.053211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.053296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.053378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.053460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.053541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.053620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.053696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.053775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.053851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.053926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.054001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.054081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.054167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.054243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.054317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.054392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.054467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.054545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.054628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.054708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.054786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.054861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.054938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.055014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.055094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.055185] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.055295] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.055299] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=55600, lrc_seqno=55600, guc_id=0, flags=0x73 in no process [-1] <7> [233.055301] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.055360] ------------[ cut here ]------------ <4> [233.055361] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.055363] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:47/3221 <4> [233.055434] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.055499] efi_pstore nfnetlink autofs4 <4> [233.055504] CPU: 6 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.055507] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.055508] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.055509] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.055514] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.055584] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.055586] RSP: 0000:ffffc90007163ca0 EFLAGS: 00010246 <4> [233.055588] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.055590] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.055591] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.055592] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.055593] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.055595] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [233.055596] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.055597] CR2: 000070b5c59ed910 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [233.055599] PKRU: 55555554 <4> [233.055600] Call Trace: <4> [233.055601] <TASK> <4> [233.055605] ? lock_sync+0x100/0x100 <4> [233.055610] ? lock_release+0xd0/0x2b0 <4> [233.055615] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.055621] process_one_work+0x239/0x760 <4> [233.055627] worker_thread+0x200/0x3f0 <4> [233.055629] ? __pfx_worker_thread+0x10/0x10 <4> [233.055632] kthread+0x10d/0x150 <4> [233.055635] ? __pfx_kthread+0x10/0x10 <4> [233.055638] ret_from_fork+0x3d4/0x480 <4> [233.055640] ? __pfx_kthread+0x10/0x10 <4> [233.055644] ret_from_fork_asm+0x1a/0x30 <4> [233.055651] </TASK> <4> [233.055652] irq event stamp: 402767 <4> [233.055653] hardirqs last enabled at (402773): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.055656] hardirqs last disabled at (402778): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.055658] softirqs last enabled at (401924): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.055661] softirqs last disabled at (401913): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.055663] ---[ end trace 0000000000000000 ]--- <7> [233.057134] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.057243] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [233.057343] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=55655, lrc_seqno=55655, guc_id=0, flags=0x73 in no process [-1] <7> [233.057345] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.057404] ------------[ cut here ]------------ <4> [233.057405] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.057406] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:47/3221 <4> [233.057477] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.057551] efi_pstore nfnetlink autofs4 <4> [233.057557] CPU: 6 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.057559] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.057561] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.057562] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.057567] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.057635] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.057637] RSP: 0000:ffffc90007163ca0 EFLAGS: 00010246 <4> [233.057639] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.057641] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.057642] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.057644] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.057645] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.057647] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [233.057648] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.057650] CR2: 000070b5c59ed910 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [233.057651] PKRU: 55555554 <4> [233.057653] Call Trace: <4> [233.057654] <TASK> <4> [233.057658] ? lock_sync+0x100/0x100 <4> [233.057662] ? lock_release+0xd0/0x2b0 <4> [233.057668] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.057673] process_one_work+0x239/0x760 <4> [233.057679] worker_thread+0x200/0x3f0 <4> [233.057682] ? __pfx_worker_thread+0x10/0x10 <4> [233.057685] kthread+0x10d/0x150 <4> [233.057688] ? __pfx_kthread+0x10/0x10 <4> [233.057692] ret_from_fork+0x3d4/0x480 <4> [233.057694] ? __pfx_kthread+0x10/0x10 <4> [233.057698] ret_from_fork_asm+0x1a/0x30 <4> [233.057705] </TASK> <4> [233.057706] irq event stamp: 405669 <4> [233.057707] hardirqs last enabled at (405675): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.057710] hardirqs last disabled at (405680): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.057712] softirqs last enabled at (404880): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.057715] softirqs last disabled at (404873): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.057717] ---[ end trace 0000000000000000 ]--- <6> [233.057719] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.057788] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.057794] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.057945] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.058160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.058251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.058344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.058433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.058520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.058605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.058692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.058779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.058862] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.058959] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.059077] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.060103] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.070139] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.070392] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.071385] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.071463] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.071539] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.071617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.071693] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.071771] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.071848] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.071925] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.072001] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.072075] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.072160] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.072234] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.072307] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.072380] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.072453] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.072526] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.072599] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.072672] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.072744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.072825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.072907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.072987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.073068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.073154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.073231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.073306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.073381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.073459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.073537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.073617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.073696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.073772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.073856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.073938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.074020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.074099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.074193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.074273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.074355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.074434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.074515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.074594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.074672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.074750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.074831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.074911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.074993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.075072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.075154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.075231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.075306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.075384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.075464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.075545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.075623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.075703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.075779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.075856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.075935] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.076047] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.076051] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=55655, lrc_seqno=55655, guc_id=0, flags=0x73 in no process [-1] <7> [233.076054] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.076113] ------------[ cut here ]------------ <4> [233.076114] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.076116] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:42/3216 <4> [233.076202] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.076267] efi_pstore nfnetlink autofs4 <4> [233.076272] CPU: 0 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.076275] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.076276] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.076277] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.076282] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.076353] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.076355] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [233.076357] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.076359] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.076360] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.076361] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.076362] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.076364] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [233.076365] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.076367] CR2: 0000738bc2804ff8 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [233.076368] PKRU: 55555554 <4> [233.076369] Call Trace: <4> [233.076370] <TASK> <4> [233.076374] ? lock_sync+0x100/0x100 <4> [233.076379] ? lock_release+0xd0/0x2b0 <4> [233.076385] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.076390] process_one_work+0x239/0x760 <4> [233.076396] worker_thread+0x200/0x3f0 <4> [233.076399] ? __pfx_worker_thread+0x10/0x10 <4> [233.076401] kthread+0x10d/0x150 <4> [233.076404] ? __pfx_kthread+0x10/0x10 <4> [233.076408] ret_from_fork+0x3d4/0x480 <4> [233.076410] ? __pfx_kthread+0x10/0x10 <4> [233.076413] ret_from_fork_asm+0x1a/0x30 <4> [233.076420] </TASK> <4> [233.076421] irq event stamp: 1232423 <4> [233.076423] hardirqs last enabled at (1232429): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.076425] hardirqs last disabled at (1232434): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.076428] softirqs last enabled at (1231514): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.076430] softirqs last disabled at (1231507): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.076432] ---[ end trace 0000000000000000 ]--- <6> [233.076434] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.076505] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.076511] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.076919] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.077122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.077222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.077315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.077402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.077486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.077570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.077659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.077749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.077832] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.077927] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.078043] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.079046] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.089150] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.089402] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.090398] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.090477] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.090552] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.090629] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.090705] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.090779] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.090853] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.090927] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.091001] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.091075] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.091152] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.091228] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.091302] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.091377] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.091454] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.091531] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.091608] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.091682] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.091757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.091838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.091918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.091996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.092076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.092162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.092240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.092316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.092393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.092472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.092553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.092633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.092714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.092794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.092879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.092963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.093046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.093127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.093216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.093293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.093368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.093445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.093530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.093611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.093691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.093769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.093849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.093926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.094006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.094085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.094173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.094250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.094326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.094406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.094483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.094559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.094635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.094713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.094789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.094868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.094948] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.095058] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.095062] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=55655, lrc_seqno=55655, guc_id=0, flags=0x73 in no process [-1] <7> [233.095065] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.095122] ------------[ cut here ]------------ <4> [233.095123] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.095125] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:42/3216 <4> [233.095209] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.095277] efi_pstore nfnetlink autofs4 <4> [233.095282] CPU: 0 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.095285] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.095287] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.095288] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.095294] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.095364] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.095366] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [233.095368] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.095370] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.095371] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.095373] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.095374] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.095376] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [233.095377] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.095379] CR2: 0000738bc2804ff8 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [233.095381] PKRU: 55555554 <4> [233.095382] Call Trace: <4> [233.095383] <TASK> <4> [233.095387] ? lock_sync+0x100/0x100 <4> [233.095392] ? lock_release+0xd0/0x2b0 <4> [233.095397] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.095403] process_one_work+0x239/0x760 <4> [233.095409] worker_thread+0x200/0x3f0 <4> [233.095412] ? __pfx_worker_thread+0x10/0x10 <4> [233.095415] kthread+0x10d/0x150 <4> [233.095418] ? __pfx_kthread+0x10/0x10 <4> [233.095422] ret_from_fork+0x3d4/0x480 <4> [233.095424] ? __pfx_kthread+0x10/0x10 <4> [233.095428] ret_from_fork_asm+0x1a/0x30 <4> [233.095435] </TASK> <4> [233.095436] irq event stamp: 1235509 <4> [233.095437] hardirqs last enabled at (1235515): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.095440] hardirqs last disabled at (1235520): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.095442] softirqs last enabled at (1234766): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.095445] softirqs last disabled at (1234761): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.095447] ---[ end trace 0000000000000000 ]--- <7> [233.096473] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.096585] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [233.096886] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=55710, lrc_seqno=55710, guc_id=0, flags=0x73 in no process [-1] <7> [233.096891] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.096955] ------------[ cut here ]------------ <4> [233.096956] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.096958] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:47/3221 <4> [233.097033] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.097098] efi_pstore nfnetlink autofs4 <4> [233.097104] CPU: 4 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.097107] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.097109] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.097110] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.097116] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.097198] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.097200] RSP: 0018:ffffc90007163ca0 EFLAGS: 00010246 <4> [233.097203] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.097205] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.097206] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.097208] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.097209] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.097211] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [233.097212] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.097214] CR2: 000072a0f00740e8 CR3: 0000000122082006 CR4: 0000000000f72ef0 <4> [233.097216] PKRU: 55555554 <4> [233.097217] Call Trace: <4> [233.097219] <TASK> <4> [233.097223] ? lock_sync+0x100/0x100 <4> [233.097228] ? lock_release+0xd0/0x2b0 <4> [233.097234] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.097240] process_one_work+0x239/0x760 <4> [233.097246] worker_thread+0x200/0x3f0 <4> [233.097249] ? __pfx_worker_thread+0x10/0x10 <4> [233.097252] kthread+0x10d/0x150 <4> [233.097255] ? __pfx_kthread+0x10/0x10 <4> [233.097259] ret_from_fork+0x3d4/0x480 <4> [233.097261] ? __pfx_kthread+0x10/0x10 <4> [233.097264] ret_from_fork_asm+0x1a/0x30 <4> [233.097272] </TASK> <4> [233.097273] irq event stamp: 408647 <4> [233.097275] hardirqs last enabled at (408653): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.097278] hardirqs last disabled at (408658): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.097281] softirqs last enabled at (408486): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.097283] softirqs last disabled at (408479): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.097286] ---[ end trace 0000000000000000 ]--- <6> [233.097288] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.097360] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.097369] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.097582] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.097844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.097983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.098123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.098264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.098397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.098529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.098662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.098797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.098927] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.099069] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.099240] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.100573] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.111171] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.111481] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.112665] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.112786] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.112904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.113024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.113143] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.113275] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.113395] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.113514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.113633] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.113752] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.113871] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.113991] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.114110] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.114234] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.114354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.114473] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.114592] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.114711] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.114831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.114955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.115079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.115215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.115306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.115386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.115468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.115547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.115626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.115705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.115785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.115868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.115951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.116030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.116116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.116211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.116294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.116374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.116453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.116531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.116609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.116688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.116770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.116849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.116926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.117002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.117082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.117157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.117249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.117324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.117402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.117476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.117550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.117628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.117703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.117779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.117854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.117933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.118012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.118089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.118175] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.118288] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.118292] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=55710, lrc_seqno=55710, guc_id=0, flags=0x73 in no process [-1] <7> [233.118294] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.118352] ------------[ cut here ]------------ <4> [233.118353] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.118355] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:48/3222 <4> [233.118425] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.118487] efi_pstore nfnetlink autofs4 <4> [233.118492] CPU: 0 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.118495] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.118496] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.118497] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.118502] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.118570] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.118572] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [233.118574] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.118576] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.118577] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.118578] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.118579] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.118580] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [233.118582] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.118583] CR2: 0000738bc2804ff8 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [233.118585] PKRU: 55555554 <4> [233.118586] Call Trace: <4> [233.118587] <TASK> <4> [233.118591] ? lock_sync+0x100/0x100 <4> [233.118595] ? lock_release+0xd0/0x2b0 <4> [233.118600] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.118606] process_one_work+0x239/0x760 <4> [233.118612] worker_thread+0x200/0x3f0 <4> [233.118615] ? __pfx_worker_thread+0x10/0x10 <4> [233.118617] kthread+0x10d/0x150 <4> [233.118620] ? __pfx_kthread+0x10/0x10 <4> [233.118624] ret_from_fork+0x3d4/0x480 <4> [233.118626] ? __pfx_kthread+0x10/0x10 <4> [233.118629] ret_from_fork_asm+0x1a/0x30 <4> [233.118637] </TASK> <4> [233.118638] irq event stamp: 329589 <4> [233.118639] hardirqs last enabled at (329595): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.118642] hardirqs last disabled at (329600): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.118644] softirqs last enabled at (328746): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.118646] softirqs last disabled at (328741): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.118649] ---[ end trace 0000000000000000 ]--- <6> [233.118650] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.118719] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.118725] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.119964] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.120070] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.120184] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.120416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.120515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.120614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.120708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.120799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.120888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.120979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.121074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.121165] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.121281] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.121406] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.122421] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.133150] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.133415] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.134413] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.134498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.134579] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.134660] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.134740] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.134820] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.134900] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.134979] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.135057] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.135136] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.135223] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.135302] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.135380] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.135458] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.135536] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.135615] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.135696] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.135774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.135853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.135940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.136027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.136111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.136200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.136285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.136369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.136453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.136535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.136619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.136702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.136785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.136868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.136953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.137045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.137136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.137233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.137320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.137403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.137485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.137565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.137646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.137729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.137810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.137891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.137970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.138054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.138134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.138222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.138303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.138386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.138467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.138549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.138634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.138714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.138796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.138877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.138957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.139036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.139118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.139207] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.139323] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.139327] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=55710, lrc_seqno=55710, guc_id=0, flags=0x73 in no process [-1] <7> [233.139330] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.139391] ------------[ cut here ]------------ <4> [233.139393] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.139394] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:42/3216 <4> [233.139470] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.139534] efi_pstore nfnetlink autofs4 <4> [233.139538] CPU: 10 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.139541] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.139543] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.139544] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.139549] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.139623] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.139625] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [233.139627] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.139629] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.139630] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.139631] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.139633] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.139634] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [233.139636] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.139637] CR2: 000070b5c344d008 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [233.139639] PKRU: 55555554 <4> [233.139640] Call Trace: <4> [233.139641] <TASK> <4> [233.139645] ? lock_sync+0x100/0x100 <4> [233.139649] ? lock_release+0xd0/0x2b0 <4> [233.139655] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.139660] process_one_work+0x239/0x760 <4> [233.139667] worker_thread+0x200/0x3f0 <4> [233.139670] ? __pfx_worker_thread+0x10/0x10 <4> [233.139672] kthread+0x10d/0x150 <4> [233.139675] ? __pfx_kthread+0x10/0x10 <4> [233.139679] ret_from_fork+0x3d4/0x480 <4> [233.139681] ? __pfx_kthread+0x10/0x10 <4> [233.139684] ret_from_fork_asm+0x1a/0x30 <4> [233.139692] </TASK> <4> [233.139693] irq event stamp: 1239731 <4> [233.139694] hardirqs last enabled at (1239737): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.139697] hardirqs last disabled at (1239742): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.139699] softirqs last enabled at (1238810): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.139702] softirqs last disabled at (1238805): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.139704] ---[ end trace 0000000000000000 ]--- <5> [233.140287] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=55765, lrc_seqno=55765, guc_id=0, flags=0x73 in no process [-1] <7> [233.140290] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.140353] ------------[ cut here ]------------ <4> [233.140354] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.140355] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:42/3216 <4> [233.140428] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.140490] efi_pstore nfnetlink autofs4 <4> [233.140494] CPU: 10 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.140497] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.140498] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.140499] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.140504] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.140579] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.140580] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [233.140582] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.140584] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.140585] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.140586] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.140587] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.140588] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [233.140590] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.140591] CR2: 000070b5c344d008 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [233.140592] PKRU: 55555554 <4> [233.140594] Call Trace: <4> [233.140595] <TASK> <4> [233.140598] ? lock_sync+0x100/0x100 <4> [233.140602] ? lock_release+0xd0/0x2b0 <4> [233.140608] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.140613] process_one_work+0x239/0x760 <4> [233.140619] worker_thread+0x200/0x3f0 <4> [233.140622] ? __pfx_worker_thread+0x10/0x10 <4> [233.140624] kthread+0x10d/0x150 <4> [233.140627] ? __pfx_kthread+0x10/0x10 <4> [233.140631] ret_from_fork+0x3d4/0x480 <4> [233.140633] ? __pfx_kthread+0x10/0x10 <4> [233.140636] ret_from_fork_asm+0x1a/0x30 <4> [233.140643] </TASK> <4> [233.140645] irq event stamp: 1242415 <4> [233.140646] hardirqs last enabled at (1242421): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.140648] hardirqs last disabled at (1242426): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.140650] softirqs last enabled at (1241206): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.140653] softirqs last disabled at (1241201): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.140655] ---[ end trace 0000000000000000 ]--- <6> [233.140657] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.140732] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.140738] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.141636] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.141753] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.141866] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.142072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.142163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.142269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.142356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.142443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.142527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.142612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.142698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.142780] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.142875] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.142992] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.143999] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.154200] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.154451] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.155476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.155554] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.155629] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.155705] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.155780] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.155855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.155930] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.156004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.156078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.156152] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.156239] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.156314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.156393] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.156471] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.156547] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.156621] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.156694] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.156768] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.156841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.156922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.157003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.157080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.157162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.157256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.157334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.157411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.157487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.157566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.157644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.157721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.157798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.157875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.157957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.158043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.158129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.158216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.158297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.158375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.158455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.158534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.158616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.158695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.158773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.158849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.158929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.159006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.159083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.159159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.159253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.159333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.159413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.159495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.159573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.159653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.159731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.159809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.159886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.159962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.160042] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.160153] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.160157] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=55765, lrc_seqno=55765, guc_id=0, flags=0x73 in no process [-1] <7> [233.160160] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.160235] ------------[ cut here ]------------ <4> [233.160237] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.160238] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:48/3222 <4> [233.160311] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.160380] efi_pstore nfnetlink autofs4 <4> [233.160385] CPU: 0 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.160388] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.160389] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.160391] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.160396] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.160467] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.160468] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [233.160471] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.160472] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.160473] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.160475] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.160476] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.160477] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [233.160479] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.160480] CR2: 0000738bc2804ff8 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [233.160482] PKRU: 55555554 <4> [233.160483] Call Trace: <4> [233.160484] <TASK> <4> [233.160487] ? lock_sync+0x100/0x100 <4> [233.160492] ? lock_release+0xd0/0x2b0 <4> [233.160497] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.160503] process_one_work+0x239/0x760 <4> [233.160509] worker_thread+0x200/0x3f0 <4> [233.160512] ? __pfx_worker_thread+0x10/0x10 <4> [233.160515] kthread+0x10d/0x150 <4> [233.160518] ? __pfx_kthread+0x10/0x10 <4> [233.160521] ret_from_fork+0x3d4/0x480 <4> [233.160523] ? __pfx_kthread+0x10/0x10 <4> [233.160527] ret_from_fork_asm+0x1a/0x30 <4> [233.160534] </TASK> <4> [233.160535] irq event stamp: 335445 <4> [233.160536] hardirqs last enabled at (335451): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.160539] hardirqs last disabled at (335456): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.160541] softirqs last enabled at (334684): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.160544] softirqs last disabled at (334677): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.160546] ---[ end trace 0000000000000000 ]--- <6> [233.160548] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.160619] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.160625] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.161914] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.162017] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.162122] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.162332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.162423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.162515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.162602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.162688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.162773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.162858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.162945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.163026] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.163120] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.163241] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.164286] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.174213] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.174463] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.175482] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.175561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.175638] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.175718] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.175797] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.175874] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.175950] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.176024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.176098] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.176172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.176255] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.176329] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.176402] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.176475] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.176549] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.176624] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.176700] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.176776] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.176850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.176932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.177014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.177092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.177172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.177258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.177336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.177415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.177494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.177576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.177656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.177735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.177814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.177892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.177976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.178059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.178143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.178228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.178310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.178388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.178466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.178544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.178622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.178700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.178776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.178851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.178932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.179008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.179085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.179160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.179245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.179319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.179394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.179472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.179551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.179630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.179707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.179784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.179861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.179941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.180022] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.180132] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.180136] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=55765, lrc_seqno=55765, guc_id=0, flags=0x73 in no process [-1] <7> [233.180139] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.180197] ------------[ cut here ]------------ <4> [233.180198] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.180199] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:42/3216 <4> [233.180285] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.180349] efi_pstore nfnetlink autofs4 <4> [233.180354] CPU: 10 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.180357] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.180358] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.180359] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.180364] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.180433] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.180435] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [233.180437] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.180438] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.180440] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.180441] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.180442] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.180443] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [233.180445] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.180446] CR2: 000070b5c344d008 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [233.180448] PKRU: 55555554 <4> [233.180449] Call Trace: <4> [233.180450] <TASK> <4> [233.180454] ? lock_sync+0x100/0x100 <4> [233.180458] ? lock_release+0xd0/0x2b0 <4> [233.180464] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.180470] process_one_work+0x239/0x760 <4> [233.180476] worker_thread+0x200/0x3f0 <4> [233.180479] ? __pfx_worker_thread+0x10/0x10 <4> [233.180481] kthread+0x10d/0x150 <4> [233.180484] ? __pfx_kthread+0x10/0x10 <4> [233.180488] ret_from_fork+0x3d4/0x480 <4> [233.180490] ? __pfx_kthread+0x10/0x10 <4> [233.180493] ret_from_fork_asm+0x1a/0x30 <4> [233.180501] </TASK> <4> [233.180502] irq event stamp: 1246285 <4> [233.180503] hardirqs last enabled at (1246291): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.180506] hardirqs last disabled at (1246296): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.180508] softirqs last enabled at (1245542): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.180511] softirqs last disabled at (1245531): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.180513] ---[ end trace 0000000000000000 ]--- <7> [233.182018] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.182123] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [233.182224] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=55820, lrc_seqno=55820, guc_id=0, flags=0x73 in no process [-1] <7> [233.182226] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.182285] ------------[ cut here ]------------ <4> [233.182287] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.182288] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:42/3216 <4> [233.182358] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.182432] efi_pstore nfnetlink autofs4 <4> [233.182437] CPU: 10 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.182439] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.182441] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.182442] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.182447] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.182516] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.182518] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [233.182520] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.182521] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.182523] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.182524] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.182525] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.182526] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [233.182528] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.182529] CR2: 000070b5c344d008 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [233.182530] PKRU: 55555554 <4> [233.182531] Call Trace: <4> [233.182533] <TASK> <4> [233.182536] ? lock_sync+0x100/0x100 <4> [233.182540] ? lock_release+0xd0/0x2b0 <4> [233.182546] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.182551] process_one_work+0x239/0x760 <4> [233.182558] worker_thread+0x200/0x3f0 <4> [233.182560] ? __pfx_worker_thread+0x10/0x10 <4> [233.182563] kthread+0x10d/0x150 <4> [233.182566] ? __pfx_kthread+0x10/0x10 <4> [233.182569] ret_from_fork+0x3d4/0x480 <4> [233.182571] ? __pfx_kthread+0x10/0x10 <4> [233.182575] ret_from_fork_asm+0x1a/0x30 <4> [233.182582] </TASK> <4> [233.182583] irq event stamp: 1248843 <4> [233.182584] hardirqs last enabled at (1248849): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.182587] hardirqs last disabled at (1248854): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.182589] softirqs last enabled at (1245542): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.182591] softirqs last disabled at (1245531): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.182594] ---[ end trace 0000000000000000 ]--- <6> [233.182595] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.182663] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.182671] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.182735] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.182936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.183024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.183115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.183206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.183306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.183391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.183474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.183558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.183638] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.183730] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.183844] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.184849] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.195229] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.195478] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.196410] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.196487] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.196561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.196637] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.196712] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.196787] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.196865] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.196941] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.197015] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.197089] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.197163] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.197241] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.197316] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.197393] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.197469] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.197544] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.197617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.197692] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.197767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.197849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.197930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.198010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.198090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.198167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.198249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.198329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.198408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.198488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.198568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.198645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.198723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.198801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.198883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.198966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.199054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.199138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.199219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.199310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.199387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.199463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.199542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.199619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.199696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.199772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.199851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.199926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.200002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.200081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.200162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.200243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.200320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.200398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.200475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.200551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.200626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.200703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.200780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.200858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.200938] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.201048] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.201052] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=55820, lrc_seqno=55820, guc_id=0, flags=0x73 in no process [-1] <7> [233.201054] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.201112] ------------[ cut here ]------------ <4> [233.201113] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.201114] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:42/3216 <4> [233.201185] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.201253] efi_pstore nfnetlink autofs4 <4> [233.201257] CPU: 10 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.201260] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.201261] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.201263] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.201268] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.201338] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.201340] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [233.201342] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.201343] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.201345] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.201346] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.201347] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.201348] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [233.201350] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.201351] CR2: 000070b5c344d008 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [233.201353] PKRU: 55555554 <4> [233.201354] Call Trace: <4> [233.201355] <TASK> <4> [233.201359] ? lock_sync+0x100/0x100 <4> [233.201363] ? lock_release+0xd0/0x2b0 <4> [233.201368] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.201374] process_one_work+0x239/0x760 <4> [233.201380] worker_thread+0x200/0x3f0 <4> [233.201383] ? __pfx_worker_thread+0x10/0x10 <4> [233.201385] kthread+0x10d/0x150 <4> [233.201388] ? __pfx_kthread+0x10/0x10 <4> [233.201391] ret_from_fork+0x3d4/0x480 <4> [233.201393] ? __pfx_kthread+0x10/0x10 <4> [233.201397] ret_from_fork_asm+0x1a/0x30 <4> [233.201404] </TASK> <4> [233.201405] irq event stamp: 1251935 <4> [233.201406] hardirqs last enabled at (1251941): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.201409] hardirqs last disabled at (1251946): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.201411] softirqs last enabled at (1251030): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.201414] softirqs last disabled at (1251023): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.201416] ---[ end trace 0000000000000000 ]--- <6> [233.202342] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.202416] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.202423] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.202435] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.202536] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.202640] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.202849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.202945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.203042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.203129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.203214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.203314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.203399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.203484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.203565] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.203659] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.203775] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.204783] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.215244] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.215495] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.216500] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.216578] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.216653] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.216729] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.216804] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.216879] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.216955] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.217029] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.217104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.217177] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.217256] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.217330] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.217403] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.217477] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.217550] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.217624] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.217698] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.217772] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.217847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.217931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.218013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.218091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.218170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.218249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.218326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.218401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.218477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.218554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.218635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.218715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.218792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.218870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.218953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.219035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.219117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.219197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.219283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.219359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.219435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.219510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.219592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.219672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.219751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.219828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.219909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.219987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.220064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.220140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.220219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.220306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.220384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.220462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.220539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.220616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.220691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.220771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.220847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.220923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.221001] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.221112] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.221116] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=55820, lrc_seqno=55820, guc_id=0, flags=0x73 in no process [-1] <7> [233.221119] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.221177] ------------[ cut here ]------------ <4> [233.221178] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.221179] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:47/3221 <4> [233.221254] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.221319] efi_pstore nfnetlink autofs4 <4> [233.221324] CPU: 6 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.221327] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.221328] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.221330] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.221335] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.221405] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.221407] RSP: 0018:ffffc90007163ca0 EFLAGS: 00010246 <4> [233.221409] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.221411] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.221412] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.221413] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.221414] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.221416] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [233.221417] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.221419] CR2: 000070b5c344e008 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [233.221420] PKRU: 55555554 <4> [233.221421] Call Trace: <4> [233.221422] <TASK> <4> [233.221426] ? lock_sync+0x100/0x100 <4> [233.221431] ? lock_release+0xd0/0x2b0 <4> [233.221437] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.221442] process_one_work+0x239/0x760 <4> [233.221449] worker_thread+0x200/0x3f0 <4> [233.221451] ? __pfx_worker_thread+0x10/0x10 <4> [233.221454] kthread+0x10d/0x150 <4> [233.221457] ? __pfx_kthread+0x10/0x10 <4> [233.221460] ret_from_fork+0x3d4/0x480 <4> [233.221462] ? __pfx_kthread+0x10/0x10 <4> [233.221465] ret_from_fork_asm+0x1a/0x30 <4> [233.221473] </TASK> <4> [233.221474] irq event stamp: 412861 <4> [233.221475] hardirqs last enabled at (412867): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.221478] hardirqs last disabled at (412872): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.221480] softirqs last enabled at (411866): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.221483] softirqs last disabled at (411859): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.221485] ---[ end trace 0000000000000000 ]--- <7> [233.223137] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.223248] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [233.223347] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=55875, lrc_seqno=55875, guc_id=0, flags=0x73 in no process [-1] <7> [233.223350] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.223409] ------------[ cut here ]------------ <4> [233.223410] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.223411] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:47/3221 <4> [233.223484] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.223546] efi_pstore nfnetlink autofs4 <4> [233.223550] CPU: 6 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.223552] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.223554] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.223555] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.223560] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.223630] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.223632] RSP: 0018:ffffc90007163ca0 EFLAGS: 00010246 <4> [233.223634] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.223635] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.223636] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.223638] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.223639] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.223640] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [233.223642] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.223643] CR2: 000070b5c344e008 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [233.223644] PKRU: 55555554 <4> [233.223645] Call Trace: <4> [233.223647] <TASK> <4> [233.223650] ? lock_sync+0x100/0x100 <4> [233.223654] ? lock_release+0xd0/0x2b0 <4> [233.223660] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.223665] process_one_work+0x239/0x760 <4> [233.223671] worker_thread+0x200/0x3f0 <4> [233.223674] ? __pfx_worker_thread+0x10/0x10 <4> [233.223676] kthread+0x10d/0x150 <4> [233.223679] ? __pfx_kthread+0x10/0x10 <4> [233.223683] ret_from_fork+0x3d4/0x480 <4> [233.223685] ? __pfx_kthread+0x10/0x10 <4> [233.223688] ret_from_fork_asm+0x1a/0x30 <4> [233.223695] </TASK> <4> [233.223696] irq event stamp: 416089 <4> [233.223697] hardirqs last enabled at (416095): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.223700] hardirqs last disabled at (416100): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.223702] softirqs last enabled at (411866): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.223705] softirqs last disabled at (411859): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.223707] ---[ end trace 0000000000000000 ]--- <6> [233.223709] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.223779] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.223786] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.223991] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.224193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.224291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.224383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.224471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.224559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.224646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.224732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.224819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.224900] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.224994] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.225109] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.226117] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.236841] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.237091] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.238116] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.238196] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.238281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.238358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.238434] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.238509] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.238585] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.238660] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.238734] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.238808] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.238883] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.238959] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.239035] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.239110] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.239185] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.239263] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.239337] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.239410] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.239484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.239565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.239645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.239726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.239807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.239882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.239958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.240034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.240110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.240188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.240274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.240356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.240435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.240514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.240598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.240682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.240766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.240847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.240927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.241004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.241080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.241156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.241239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.241329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.241408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.241484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.241564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.241640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.241716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.241792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.241872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.241947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.242021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.242099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.242175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.242251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.242341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.242418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.242493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.242570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.242654] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.242763] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.242767] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=55875, lrc_seqno=55875, guc_id=0, flags=0x73 in no process [-1] <7> [233.242770] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.242829] ------------[ cut here ]------------ <4> [233.242830] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.242831] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:47/3221 <4> [233.242902] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.242975] efi_pstore nfnetlink autofs4 <4> [233.242979] CPU: 6 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.242982] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.242984] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.242985] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.242990] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.243060] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.243062] RSP: 0018:ffffc90007163ca0 EFLAGS: 00010246 <4> [233.243064] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.243066] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.243067] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.243069] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.243070] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.243072] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [233.243074] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.243075] CR2: 000070b5c344e008 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [233.243077] PKRU: 55555554 <4> [233.243078] Call Trace: <4> [233.243080] <TASK> <4> [233.243084] ? lock_sync+0x100/0x100 <4> [233.243088] ? lock_release+0xd0/0x2b0 <4> [233.243094] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.243099] process_one_work+0x239/0x760 <4> [233.243106] worker_thread+0x200/0x3f0 <4> [233.243108] ? __pfx_worker_thread+0x10/0x10 <4> [233.243111] kthread+0x10d/0x150 <4> [233.243114] ? __pfx_kthread+0x10/0x10 <4> [233.243118] ret_from_fork+0x3d4/0x480 <4> [233.243120] ? __pfx_kthread+0x10/0x10 <4> [233.243124] ret_from_fork_asm+0x1a/0x30 <4> [233.243131] </TASK> <4> [233.243132] irq event stamp: 419199 <4> [233.243134] hardirqs last enabled at (419205): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.243136] hardirqs last disabled at (419210): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.243138] softirqs last enabled at (418332): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.243141] softirqs last disabled at (418321): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.243143] ---[ end trace 0000000000000000 ]--- <6> [233.243145] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.243216] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.243221] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.244515] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.244620] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.244730] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.244942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.245033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.245126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.245213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.245314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.245400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.245485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.245572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.245654] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.245750] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.245866] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.246888] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.257616] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.257867] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.258879] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.258959] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.259035] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.259112] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.259188] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.259263] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.259354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.259433] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.259509] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.259585] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.259660] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.259735] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.259809] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.259883] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.259960] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.260036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.260111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.260186] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.260259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.260353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.260434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.260513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.260595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.260676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.260755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.260831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.260906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.260984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.261063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.261140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.261217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.261300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.261384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.261467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.261554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.261637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.261716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.261793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.261870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.261946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.262026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.262102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.262178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.262254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.262344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.262423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.262504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.262582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.262661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.262738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.262814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.262893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.262969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.263045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.263123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.263204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.263284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.263362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.263440] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.263551] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.263556] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=55875, lrc_seqno=55875, guc_id=0, flags=0x73 in no process [-1] <7> [233.263559] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.263618] ------------[ cut here ]------------ <4> [233.263619] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.263621] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:47/3221 <4> [233.263691] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.263761] efi_pstore nfnetlink autofs4 <4> [233.263766] CPU: 7 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.263769] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.263770] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.263772] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.263777] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.263849] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.263851] RSP: 0018:ffffc90007163ca0 EFLAGS: 00010246 <4> [233.263853] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.263854] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.263855] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.263857] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.263858] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.263859] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000 <4> [233.263861] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.263862] CR2: 0000738bc0802898 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [233.263864] PKRU: 55555554 <4> [233.263865] Call Trace: <4> [233.263866] <TASK> <4> [233.263870] ? lock_sync+0x100/0x100 <4> [233.263875] ? lock_release+0xd0/0x2b0 <4> [233.263880] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.263886] process_one_work+0x239/0x760 <4> [233.263892] worker_thread+0x200/0x3f0 <4> [233.263895] ? __pfx_worker_thread+0x10/0x10 <4> [233.263897] kthread+0x10d/0x150 <4> [233.263900] ? __pfx_kthread+0x10/0x10 <4> [233.263904] ret_from_fork+0x3d4/0x480 <4> [233.263906] ? __pfx_kthread+0x10/0x10 <4> [233.263909] ret_from_fork_asm+0x1a/0x30 <4> [233.263916] </TASK> <4> [233.263918] irq event stamp: 422319 <4> [233.263919] hardirqs last enabled at (422325): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.263921] hardirqs last disabled at (422330): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.263924] softirqs last enabled at (421464): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.263926] softirqs last disabled at (421457): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.263928] ---[ end trace 0000000000000000 ]--- <5> [233.265297] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=55930, lrc_seqno=55930, guc_id=0, flags=0x73 in no process [-1] <7> [233.265308] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.265592] ------------[ cut here ]------------ <4> [233.265594] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.265596] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:47/3221 <4> [233.265668] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core <7> [233.265691] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [233.265764] pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.265785] CPU: 6 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.265788] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.265790] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.265791] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.265799] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.265913] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <7> [233.265842] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [233.265916] RSP: 0018:ffffc90007163ca0 EFLAGS: 00010246 <4> [233.265919] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.265921] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.265923] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.265924] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.265926] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.265927] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [233.265930] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.265931] CR2: 000070b5c344e008 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [233.265933] PKRU: 55555554 <4> [233.265934] Call Trace: <4> [233.265936] <TASK> <4> [233.265941] ? lock_sync+0x100/0x100 <4> [233.265947] ? lock_release+0xd0/0x2b0 <4> [233.265956] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.265966] process_one_work+0x239/0x760 <4> [233.265976] worker_thread+0x200/0x3f0 <4> [233.265981] ? __pfx_worker_thread+0x10/0x10 <4> [233.265984] kthread+0x10d/0x150 <4> [233.265988] ? __pfx_kthread+0x10/0x10 <4> [233.265993] ret_from_fork+0x3d4/0x480 <4> [233.265997] ? __pfx_kthread+0x10/0x10 <4> [233.266001] ret_from_fork_asm+0x1a/0x30 <4> [233.266008] </TASK> <4> [233.266009] irq event stamp: 425565 <4> [233.266010] hardirqs last enabled at (425571): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.266013] hardirqs last disabled at (425576): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.266015] softirqs last enabled at (421464): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.266018] softirqs last disabled at (421457): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.266020] ---[ end trace 0000000000000000 ]--- <6> [233.266022] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.266095] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.266103] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.266262] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.266528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.266666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.266808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.266942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.267074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.267206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.267346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.267481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.267612] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.267755] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.267921] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.269316] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.279293] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.279604] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.280754] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.280875] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.280992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.281113] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.281233] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.281362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.281483] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.281602] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.281721] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.281840] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.281959] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.282078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.282198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.282323] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.282442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.282562] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.282681] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.282799] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.282919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.283043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.283167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.283295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.283419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.283541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.283664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.283786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.283908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.284034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.284160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.284289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.284415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.284541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.284672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.284802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.284931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.285059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.285186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.285319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.285443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.285565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.285691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.285815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.285939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.286061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.286188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.286317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.286441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.286562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.286687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.286809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.286930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.287056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.287179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.287307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.287429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.287554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.287675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.287797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.287923] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.288082] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.288089] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=55930, lrc_seqno=55930, guc_id=0, flags=0x73 in no process [-1] <7> [233.288093] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.288194] ------------[ cut here ]------------ <4> [233.288196] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.288198] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#12: kworker/u64:42/3216 <4> [233.288315] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.288408] efi_pstore nfnetlink autofs4 <4> [233.288414] CPU: 12 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.288418] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.288420] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.288422] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.288430] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.288541] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.288544] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [233.288547] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.288549] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.288551] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.288553] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.288555] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.288557] FS: 0000000000000000(0000) GS:ffff8888db297000(0000) knlGS:0000000000000000 <4> [233.288559] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.288561] CR2: 0000738bc28038d8 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [233.288563] PKRU: 55555554 <4> [233.288565] Call Trace: <4> [233.288567] <TASK> <4> [233.288574] ? lock_sync+0x100/0x100 <4> [233.288582] ? lock_release+0xd0/0x2b0 <4> [233.288591] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.288600] process_one_work+0x239/0x760 <4> [233.288611] worker_thread+0x200/0x3f0 <4> [233.288615] ? __pfx_worker_thread+0x10/0x10 <4> [233.288619] kthread+0x10d/0x150 <4> [233.288623] ? __pfx_kthread+0x10/0x10 <4> [233.288629] ret_from_fork+0x3d4/0x480 <4> [233.288632] ? __pfx_kthread+0x10/0x10 <4> [233.288638] ret_from_fork_asm+0x1a/0x30 <4> [233.288650] </TASK> <4> [233.288652] irq event stamp: 1260247 <4> [233.288654] hardirqs last enabled at (1260253): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.288658] hardirqs last disabled at (1260258): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.288662] softirqs last enabled at (1259316): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.288665] softirqs last disabled at (1259309): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.288669] ---[ end trace 0000000000000000 ]--- <6> [233.288672] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.288783] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.288791] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.289202] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.289927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.290060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.290195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.290342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.290436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.290526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.290615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.290703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.290787] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.290883] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.291001] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.292022] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.302307] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.302555] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.303559] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.303638] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.303713] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.303791] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.303869] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.303947] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.304023] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.304098] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.304173] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.304247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.304327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.304401] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.304475] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.304549] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.304622] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.304696] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.304771] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.304847] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.304922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.305005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.305086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.305166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.305246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.305331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.305410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.305487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.305563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.305642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.305720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.305797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.305874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.305952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.306035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.306123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.306210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.306291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.306383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.306460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.306537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.306616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.306697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.306775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.306852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.306928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.307007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.307083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.307160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.307236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.307320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.307399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.307476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.307556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.307634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.307711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.307789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.307867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.307941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.308016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.308099] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.308213] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.308217] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=55930, lrc_seqno=55930, guc_id=0, flags=0x73 in no process [-1] <7> [233.308219] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.308279] ------------[ cut here ]------------ <4> [233.308280] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.308281] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:42/3216 <4> [233.308362] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.308425] efi_pstore nfnetlink autofs4 <4> [233.308429] CPU: 6 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.308432] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.308433] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.308435] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.308440] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.308509] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.308511] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [233.308513] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.308514] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.308515] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.308517] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.308518] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.308519] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [233.308521] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.308522] CR2: 000070b5c344e008 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [233.308523] PKRU: 55555554 <4> [233.308525] Call Trace: <4> [233.308526] <TASK> <4> [233.308530] ? lock_sync+0x100/0x100 <4> [233.308534] ? lock_release+0xd0/0x2b0 <4> [233.308539] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.308545] process_one_work+0x239/0x760 <4> [233.308551] worker_thread+0x200/0x3f0 <4> [233.308553] ? __pfx_worker_thread+0x10/0x10 <4> [233.308556] kthread+0x10d/0x150 <4> [233.308558] ? __pfx_kthread+0x10/0x10 <4> [233.308562] ret_from_fork+0x3d4/0x480 <4> [233.308564] ? __pfx_kthread+0x10/0x10 <4> [233.308567] ret_from_fork_asm+0x1a/0x30 <4> [233.308575] </TASK> <4> [233.308576] irq event stamp: 1263357 <4> [233.308577] hardirqs last enabled at (1263363): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.308580] hardirqs last disabled at (1263368): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.308582] softirqs last enabled at (1262362): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.308584] softirqs last disabled at (1262355): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.308587] ---[ end trace 0000000000000000 ]--- <5> [233.309952] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=55985, lrc_seqno=55985, guc_id=0, flags=0x73 in no process [-1] <7> [233.309955] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.310015] ------------[ cut here ]------------ <4> [233.310016] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.310017] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:42/3216 <4> [233.310087] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.310149] efi_pstore nfnetlink autofs4 <4> [233.310153] CPU: 6 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.310156] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.310157] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.310158] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.310163] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.310234] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.310236] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [233.310238] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.310239] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.310240] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.310241] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.310243] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.310244] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [233.310245] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.310247] CR2: 000070b5c344e008 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [233.310248] PKRU: 55555554 <4> [233.310249] Call Trace: <4> [233.310250] <TASK> <4> [233.310254] ? lock_sync+0x100/0x100 <4> [233.310258] ? lock_release+0xd0/0x2b0 <4> [233.310263] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.310269] process_one_work+0x239/0x760 <4> [233.310275] worker_thread+0x200/0x3f0 <4> [233.310277] ? __pfx_worker_thread+0x10/0x10 <4> [233.310280] kthread+0x10d/0x150 <4> [233.310283] ? __pfx_kthread+0x10/0x10 <4> [233.310286] ret_from_fork+0x3d4/0x480 <4> [233.310288] ? __pfx_kthread+0x10/0x10 <4> [233.310291] ret_from_fork_asm+0x1a/0x30 <4> [233.310299] </TASK> <4> [233.310300] irq event stamp: 1266001 <4> [233.310301] hardirqs last enabled at (1266007): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.310303] hardirqs last disabled at (1266012): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.310310] softirqs last enabled at (1262362): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.310313] softirqs last disabled at (1262355): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.310315] ---[ end trace 0000000000000000 ]--- <7> [233.310328] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.310433] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [233.310530] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.310601] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.310607] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.310657] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.310868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.310962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.311057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.311145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.311231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.311324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.311420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.311506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.311591] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.311687] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.311804] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.312816] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.323324] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.323572] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.324638] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.324740] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.324819] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.324898] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.324976] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.325054] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.325133] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.325211] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.325287] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.325379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.325463] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.325536] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.325610] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.325684] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.325757] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.325830] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.325903] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.325976] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.326049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.326130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.326212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.326292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.326390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.326482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.326560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.326636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.326713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.326792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.326873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.326952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.327030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.327112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.327201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.327288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.327386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.327477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.327558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.327636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.327714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.327789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.327866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.327945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.328024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.328101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.328182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.328259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.328345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.328437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.328518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.328596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.328672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.328752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.328828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.328905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.328982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.329063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.329142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.329220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.329299] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.329438] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.329443] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=55985, lrc_seqno=55985, guc_id=0, flags=0x73 in no process [-1] <7> [233.329445] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.329505] ------------[ cut here ]------------ <4> [233.329506] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.329507] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:48/3222 <4> [233.329579] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.329642] efi_pstore nfnetlink autofs4 <4> [233.329647] CPU: 8 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.329650] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.329651] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.329653] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.329658] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.329728] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.329729] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [233.329731] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.329733] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.329734] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.329735] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.329737] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.329738] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [233.329740] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.329741] CR2: 0000738bc2004f58 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [233.329742] PKRU: 55555554 <4> [233.329744] Call Trace: <4> [233.329745] <TASK> <4> [233.329749] ? lock_sync+0x100/0x100 <4> [233.329753] ? lock_release+0xd0/0x2b0 <4> [233.329759] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.329764] process_one_work+0x239/0x760 <4> [233.329770] worker_thread+0x200/0x3f0 <4> [233.329773] ? __pfx_worker_thread+0x10/0x10 <4> [233.329775] kthread+0x10d/0x150 <4> [233.329778] ? __pfx_kthread+0x10/0x10 <4> [233.329782] ret_from_fork+0x3d4/0x480 <4> [233.329784] ? __pfx_kthread+0x10/0x10 <4> [233.329788] ret_from_fork_asm+0x1a/0x30 <4> [233.329795] </TASK> <4> [233.329796] irq event stamp: 346835 <4> [233.329797] hardirqs last enabled at (346841): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.329800] hardirqs last disabled at (346846): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.329802] softirqs last enabled at (346000): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.329805] softirqs last disabled at (345985): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.329807] ---[ end trace 0000000000000000 ]--- <6> [233.329809] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.329880] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.329886] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.331126] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.331235] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.331349] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.331552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.331640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.331733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.331820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.331905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.331989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.332077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.332165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.332247] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.332347] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.332463] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.333470] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.343345] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.343593] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.344551] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.344631] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.344708] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.344784] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.344859] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.344934] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.345008] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.345083] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.345157] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.345231] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.345306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.345391] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.345464] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.345538] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.345612] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.345685] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.345758] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.345830] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.345904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.345985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.346066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.346146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.346228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.346305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.346393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.346471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.346547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.346626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.346704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.346781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.346857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.346938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.347024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.347109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.347194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.347275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.347360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.347443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.347522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.347599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.347678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.347756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.347833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.347908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.347988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.348063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.348138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.348213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.348292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.348381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.348460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.348540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.348619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.348697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.348775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.348854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.348929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.349005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.349085] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.349195] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.349199] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=55985, lrc_seqno=55985, guc_id=0, flags=0x73 in no process [-1] <7> [233.349202] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.349260] ------------[ cut here ]------------ <4> [233.349261] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.349263] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:42/3216 <4> [233.349338] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.349403] efi_pstore nfnetlink autofs4 <4> [233.349407] CPU: 6 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.349410] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.349412] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.349413] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.349418] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.349488] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.349489] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [233.349492] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.349493] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.349494] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.349496] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.349497] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.349498] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [233.349500] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.349501] CR2: 000070b5c344e008 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [233.349503] PKRU: 55555554 <4> [233.349504] Call Trace: <4> [233.349505] <TASK> <4> [233.349509] ? lock_sync+0x100/0x100 <4> [233.349513] ? lock_release+0xd0/0x2b0 <4> [233.349519] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.349524] process_one_work+0x239/0x760 <4> [233.349531] worker_thread+0x200/0x3f0 <4> [233.349533] ? __pfx_worker_thread+0x10/0x10 <4> [233.349536] kthread+0x10d/0x150 <4> [233.349539] ? __pfx_kthread+0x10/0x10 <4> [233.349542] ret_from_fork+0x3d4/0x480 <4> [233.349544] ? __pfx_kthread+0x10/0x10 <4> [233.349548] ret_from_fork_asm+0x1a/0x30 <4> [233.349555] </TASK> <4> [233.349556] irq event stamp: 1269631 <4> [233.349557] hardirqs last enabled at (1269637): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.349560] hardirqs last disabled at (1269642): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.349563] softirqs last enabled at (1268540): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.349565] softirqs last disabled at (1268531): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.349567] ---[ end trace 0000000000000000 ]--- <7> [233.351095] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.351198] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [233.351298] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56040, lrc_seqno=56040, guc_id=0, flags=0x73 in no process [-1] <7> [233.351300] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.351374] ------------[ cut here ]------------ <4> [233.351376] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.351377] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:42/3216 <4> [233.351449] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.351525] efi_pstore nfnetlink autofs4 <4> [233.351529] CPU: 6 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.351532] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.351534] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.351535] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.351541] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.351610] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.351612] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [233.351614] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.351615] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.351616] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.351618] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.351619] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.351620] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [233.351622] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.351623] CR2: 000070b5c344e008 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [233.351624] PKRU: 55555554 <4> [233.351626] Call Trace: <4> [233.351627] <TASK> <4> [233.351630] ? lock_sync+0x100/0x100 <4> [233.351635] ? lock_release+0xd0/0x2b0 <4> [233.351640] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.351646] process_one_work+0x239/0x760 <4> [233.351652] worker_thread+0x200/0x3f0 <4> [233.351655] ? __pfx_worker_thread+0x10/0x10 <4> [233.351657] kthread+0x10d/0x150 <4> [233.351660] ? __pfx_kthread+0x10/0x10 <4> [233.351664] ret_from_fork+0x3d4/0x480 <4> [233.351666] ? __pfx_kthread+0x10/0x10 <4> [233.351669] ret_from_fork_asm+0x1a/0x30 <4> [233.351676] </TASK> <4> [233.351677] irq event stamp: 1272323 <4> [233.351678] hardirqs last enabled at (1272329): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.351681] hardirqs last disabled at (1272334): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.351683] softirqs last enabled at (1271562): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.351686] softirqs last disabled at (1271555): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.351688] ---[ end trace 0000000000000000 ]--- <6> [233.351690] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.351759] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.351764] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.352009] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.352212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.352301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.352404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.352492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.352578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.352663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.352750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.352839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.352923] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.353017] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.353134] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.354145] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.364354] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.364605] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.365610] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.365690] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.365767] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.365843] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.365918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.365994] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.366070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.366146] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.366222] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.366298] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.366379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.366454] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.366528] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.366601] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.366674] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.366747] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.366820] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.366894] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.366969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.367053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.367134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.367212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.367292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.367373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.367451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.367531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.367610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.367690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.367771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.367850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.367929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.368006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.368090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.368172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.368254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.368333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.368423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.368503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.368584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.368662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.368742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.368820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.368897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.368973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.369053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.369129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.369204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.369280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.369364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.369442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.369519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.369598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.369676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.369757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.369836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.369915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.369991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.370067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.370146] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.370256] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.370260] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56040, lrc_seqno=56040, guc_id=0, flags=0x73 in no process [-1] <7> [233.370263] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.370322] ------------[ cut here ]------------ <4> [233.370323] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.370324] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:42/3216 <4> [233.370404] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.370468] efi_pstore nfnetlink autofs4 <4> [233.370472] CPU: 6 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.370475] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.370476] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.370478] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.370483] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.370552] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.370553] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [233.370556] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.370557] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.370558] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.370560] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.370561] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.370562] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [233.370564] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.370565] CR2: 000070b5c344e008 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [233.370566] PKRU: 55555554 <4> [233.370568] Call Trace: <4> [233.370569] <TASK> <4> [233.370572] ? lock_sync+0x100/0x100 <4> [233.370577] ? lock_release+0xd0/0x2b0 <4> [233.370582] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.370588] process_one_work+0x239/0x760 <4> [233.370594] worker_thread+0x200/0x3f0 <4> [233.370597] ? __pfx_worker_thread+0x10/0x10 <4> [233.370599] kthread+0x10d/0x150 <4> [233.370602] ? __pfx_kthread+0x10/0x10 <4> [233.370606] ret_from_fork+0x3d4/0x480 <4> [233.370608] ? __pfx_kthread+0x10/0x10 <4> [233.370611] ret_from_fork_asm+0x1a/0x30 <4> [233.370618] </TASK> <4> [233.370619] irq event stamp: 1275409 <4> [233.370621] hardirqs last enabled at (1275415): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.370623] hardirqs last disabled at (1275420): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.370626] softirqs last enabled at (1274500): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.370628] softirqs last disabled at (1274493): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.370631] ---[ end trace 0000000000000000 ]--- <6> [233.371387] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.371595] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.371603] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.371657] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.371761] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.371868] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.372074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.372163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.372256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.372343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.372447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.372530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.372615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.372700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.372782] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.372875] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.372991] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.374001] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.384711] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.384952] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.385923] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.385995] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.386064] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.386134] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.386205] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.386276] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.386345] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.386426] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.386501] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.386574] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.386648] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.386722] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.386795] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.386868] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.386943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.387020] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.387094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.387170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.387244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.387324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.387412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.387490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.387569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.387646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.387722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.387799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.387875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.387954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.388035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.388117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.388198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.388277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.388362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.388460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.388544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.388625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.388703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.388781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.388858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.388932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.389011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.389091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.389170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.389246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.389327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.389415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.389496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.389574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.389652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.389727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.389802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.389880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.389959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.390040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.390119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.390197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.390273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.390348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.390438] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.390549] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.390553] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56040, lrc_seqno=56040, guc_id=0, flags=0x73 in no process [-1] <7> [233.390556] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.390614] ------------[ cut here ]------------ <4> [233.390615] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.390617] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:42/3216 <4> [233.390688] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.390755] efi_pstore nfnetlink autofs4 <4> [233.390760] CPU: 7 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.390763] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.390765] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.390766] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.390772] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.390841] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.390843] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [233.390846] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.390847] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.390849] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.390850] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.390851] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.390853] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000 <4> [233.390855] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.390856] CR2: 0000738bc0802898 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [233.390858] PKRU: 55555554 <4> [233.390860] Call Trace: <4> [233.390861] <TASK> <4> [233.390865] ? lock_sync+0x100/0x100 <4> [233.390870] ? lock_release+0xd0/0x2b0 <4> [233.390876] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.390881] process_one_work+0x239/0x760 <4> [233.390888] worker_thread+0x200/0x3f0 <4> [233.390891] ? __pfx_worker_thread+0x10/0x10 <4> [233.390893] kthread+0x10d/0x150 <4> [233.390896] ? __pfx_kthread+0x10/0x10 <4> [233.390900] ret_from_fork+0x3d4/0x480 <4> [233.390903] ? __pfx_kthread+0x10/0x10 <4> [233.390906] ret_from_fork_asm+0x1a/0x30 <4> [233.390914] </TASK> <4> [233.390915] irq event stamp: 1278531 <4> [233.390916] hardirqs last enabled at (1278537): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.390919] hardirqs last disabled at (1278542): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.390921] softirqs last enabled at (1277688): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.390924] softirqs last disabled at (1277677): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.390926] ---[ end trace 0000000000000000 ]--- <5> [233.392022] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56095, lrc_seqno=56095, guc_id=0, flags=0x73 in no process [-1] <7> [233.392028] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.392137] ------------[ cut here ]------------ <4> [233.392141] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.392142] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:48/3222 <4> [233.392221] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.392296] efi_pstore nfnetlink autofs4 <4> [233.392302] CPU: 8 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.392305] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.392306] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.392308] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.392313] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.392422] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.392425] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [233.392429] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.392431] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.392434] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.392436] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.392438] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.392441] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [233.392444] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.392446] CR2: 0000738bc2004f58 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [233.392449] PKRU: 55555554 <4> [233.392451] Call Trace: <4> [233.392453] <TASK> <4> [233.392461] ? lock_sync+0x100/0x100 <4> [233.392469] ? lock_release+0xd0/0x2b0 <4> [233.392478] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.392489] process_one_work+0x239/0x760 <4> [233.392500] worker_thread+0x200/0x3f0 <4> [233.392506] ? __pfx_worker_thread+0x10/0x10 <4> [233.392510] kthread+0x10d/0x150 <4> [233.392514] ? __pfx_kthread+0x10/0x10 <4> [233.392520] ret_from_fork+0x3d4/0x480 <4> [233.392524] ? __pfx_kthread+0x10/0x10 <4> [233.392529] ret_from_fork_asm+0x1a/0x30 <4> [233.392543] </TASK> <4> [233.392545] irq event stamp: 351345 <4> [233.392547] hardirqs last enabled at (351351): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.392552] hardirqs last disabled at (351356): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.392555] softirqs last enabled at (351184): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.392559] softirqs last disabled at (351085): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.392563] ---[ end trace 0000000000000000 ]--- <6> [233.392566] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.392644] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.392650] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.392640] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.392750] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.392859] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.393062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.393151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.393244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.393334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.393450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.393538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.393623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.393709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.393790] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.393883] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.394001] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.395017] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.405384] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.405635] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.406648] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.406739] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.406815] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.406892] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.406968] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.407044] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.407119] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.407195] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.407273] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.407349] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.407439] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.407523] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.407597] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.407670] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.407744] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.407817] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.407890] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.407964] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.408037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.408118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.408201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.408282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.408362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.408453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.408541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.408616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.408692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.408770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.408849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.408930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.409012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.409091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.409175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.409259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.409343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.409438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.409526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.409603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.409680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.409759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.409842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.409920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.409998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.410074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.410155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.410231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.410308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.410391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.410482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.410560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.410638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.410719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.410797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.410873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.410948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.411025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.411101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.411176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.411256] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.411368] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.411373] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56095, lrc_seqno=56095, guc_id=0, flags=0x73 in no process [-1] <7> [233.411375] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.411469] ------------[ cut here ]------------ <4> [233.411471] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.411474] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:48/3222 <4> [233.411555] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.411618] efi_pstore nfnetlink autofs4 <4> [233.411622] CPU: 8 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.411625] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.411626] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.411627] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.411633] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.411703] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.411705] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [233.411707] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.411709] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.411710] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.411711] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.411712] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.411714] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [233.411715] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.411717] CR2: 0000738bc2004f58 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [233.411718] PKRU: 55555554 <4> [233.411719] Call Trace: <4> [233.411720] <TASK> <4> [233.411724] ? lock_sync+0x100/0x100 <4> [233.411728] ? lock_release+0xd0/0x2b0 <4> [233.411734] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.411739] process_one_work+0x239/0x760 <4> [233.411745] worker_thread+0x200/0x3f0 <4> [233.411748] ? __pfx_worker_thread+0x10/0x10 <4> [233.411751] kthread+0x10d/0x150 <4> [233.411753] ? __pfx_kthread+0x10/0x10 <4> [233.411757] ret_from_fork+0x3d4/0x480 <4> [233.411759] ? __pfx_kthread+0x10/0x10 <4> [233.411762] ret_from_fork_asm+0x1a/0x30 <4> [233.411769] </TASK> <4> [233.411771] irq event stamp: 354455 <4> [233.411772] hardirqs last enabled at (354461): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.411775] hardirqs last disabled at (354466): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.411777] softirqs last enabled at (353694): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.411779] softirqs last disabled at (353667): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.411782] ---[ end trace 0000000000000000 ]--- <6> [233.411784] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.411854] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.411860] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.413095] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.413201] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.413306] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.413517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.413609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.413704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.413794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.413884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.413971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.414057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.414144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.414227] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.414323] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.414447] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.415456] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.426181] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.426422] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.427427] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.427505] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.427573] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.427643] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.427713] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.427783] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.427852] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.427920] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.427988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.428055] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.428123] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.428191] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.428259] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.428326] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.428402] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.428477] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.428552] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.428627] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.428701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.428781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.428861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.428940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.429019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.429096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.429172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.429248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.429326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.429407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.429487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.429564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.429641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.429720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.429803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.429886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.429969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.430050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.430129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.430205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.430281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.430356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.430443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.430520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.430595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.430669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.430750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.430825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.430903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.430982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.431062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.431139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.431215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.431296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.431372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.431457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.431532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.431609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.431684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.431759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.431839] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.431949] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.431953] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56095, lrc_seqno=56095, guc_id=0, flags=0x73 in no process [-1] <7> [233.431956] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.432014] ------------[ cut here ]------------ <4> [233.432015] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.432016] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:42/3216 <4> [233.432087] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.432150] efi_pstore nfnetlink autofs4 <4> [233.432155] CPU: 7 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.432158] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.432159] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.432160] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.432165] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.432235] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.432236] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [233.432239] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.432241] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.432242] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.432244] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.432245] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.432247] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000 <4> [233.432249] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.432250] CR2: 0000738bc0802898 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [233.432252] PKRU: 55555554 <4> [233.432254] Call Trace: <4> [233.432255] <TASK> <4> [233.432259] ? lock_sync+0x100/0x100 <4> [233.432264] ? lock_release+0xd0/0x2b0 <4> [233.432270] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.432276] process_one_work+0x239/0x760 <4> [233.432282] worker_thread+0x200/0x3f0 <4> [233.432285] ? __pfx_worker_thread+0x10/0x10 <4> [233.432288] kthread+0x10d/0x150 <4> [233.432291] ? __pfx_kthread+0x10/0x10 <4> [233.432295] ret_from_fork+0x3d4/0x480 <4> [233.432297] ? __pfx_kthread+0x10/0x10 <4> [233.432301] ret_from_fork_asm+0x1a/0x30 <4> [233.432308] </TASK> <4> [233.432309] irq event stamp: 1282221 <4> [233.432311] hardirqs last enabled at (1282227): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.432314] hardirqs last disabled at (1282232): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.432316] softirqs last enabled at (1281348): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.432319] softirqs last disabled at (1281337): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.432322] ---[ end trace 0000000000000000 ]--- <5> [233.433109] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56150, lrc_seqno=56150, guc_id=0, flags=0x73 in no process [-1] <7> [233.433114] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.433215] ------------[ cut here ]------------ <4> [233.433217] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.433219] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:48/3222 <4> [233.433294] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.433365] efi_pstore nfnetlink autofs4 <4> [233.433372] CPU: 8 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.433376] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.433379] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.433381] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.433389] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.433502] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.433506] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [233.433510] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.433514] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.433517] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.433519] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.433521] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.433524] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [233.433527] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.433530] CR2: 0000738bc2004f58 CR3: 0000000122082002 CR4: 0000000000f72ef0 <4> [233.433533] PKRU: 55555554 <4> [233.433535] Call Trace: <4> [233.433537] <TASK> <4> [233.433546] ? lock_sync+0x100/0x100 <4> [233.433555] ? lock_release+0xd0/0x2b0 <4> [233.433566] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.433579] process_one_work+0x239/0x760 <4> [233.433592] worker_thread+0x200/0x3f0 <4> [233.433597] ? __pfx_worker_thread+0x10/0x10 <4> [233.433602] kthread+0x10d/0x150 <4> [233.433608] ? __pfx_kthread+0x10/0x10 <4> [233.433614] ret_from_fork+0x3d4/0x480 <4> [233.433619] ? __pfx_kthread+0x10/0x10 <4> [233.433625] ret_from_fork_asm+0x1a/0x30 <4> [233.433639] </TASK> <4> [233.433641] irq event stamp: 356447 <4> [233.433644] hardirqs last enabled at (356453): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.433651] hardirqs last disabled at (356458): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.433655] softirqs last enabled at (356286): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.433660] softirqs last disabled at (356281): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.433664] ---[ end trace 0000000000000000 ]--- <6> [233.433667] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.433745] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.433752] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.433767] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.433867] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.433973] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.434183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.434274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.434366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.434504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.434590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.434675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.434760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.434847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.434930] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.435024] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.435140] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.436148] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.446757] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.447011] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.447990] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.448070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.448146] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.448223] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.448300] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.448376] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.448464] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.448540] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.448616] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.448690] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.448764] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.448836] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.448909] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.448985] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.449061] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.449136] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.449211] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.449285] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.449358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.449446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.449527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.449606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.449685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.449762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.449840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.449918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.449995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.450075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.450155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.450235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.450315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.450393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.450489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.450572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.450656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.450736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.450814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.450891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.450971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.451050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.451131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.451209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.451287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.451364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.451450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.451527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.451605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.451684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.451762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.451838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.451915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.451997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.452076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.452154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.452231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.452308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.452383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.452468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.452548] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.452658] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.452662] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56150, lrc_seqno=56150, guc_id=0, flags=0x73 in no process [-1] <7> [233.452665] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.452723] ------------[ cut here ]------------ <4> [233.452724] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.452726] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:47/3221 <4> [233.452798] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.452874] efi_pstore nfnetlink autofs4 <4> [233.452879] CPU: 4 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.452883] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.452884] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.452886] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.452891] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.452961] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.452963] RSP: 0018:ffffc90007163ca0 EFLAGS: 00010246 <4> [233.452965] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.452966] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.452968] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.452969] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.452970] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.452971] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [233.452973] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.452974] CR2: 000072a0f00740e8 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [233.452976] PKRU: 55555554 <4> [233.452977] Call Trace: <4> [233.452978] <TASK> <4> [233.452982] ? lock_sync+0x100/0x100 <4> [233.452987] ? lock_release+0xd0/0x2b0 <4> [233.452992] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.452998] process_one_work+0x239/0x760 <4> [233.453004] worker_thread+0x200/0x3f0 <4> [233.453007] ? __pfx_worker_thread+0x10/0x10 <4> [233.453009] kthread+0x10d/0x150 <4> [233.453012] ? __pfx_kthread+0x10/0x10 <4> [233.453016] ret_from_fork+0x3d4/0x480 <4> [233.453018] ? __pfx_kthread+0x10/0x10 <4> [233.453021] ret_from_fork_asm+0x1a/0x30 <4> [233.453028] </TASK> <4> [233.453030] irq event stamp: 436971 <4> [233.453031] hardirqs last enabled at (436977): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.453034] hardirqs last disabled at (436982): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.453036] softirqs last enabled at (436122): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.453038] softirqs last disabled at (436111): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.453040] ---[ end trace 0000000000000000 ]--- <6> [233.453042] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.453112] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.453118] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.453525] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.453727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.453818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.453910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.453999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.454085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.454171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.454261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.454351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.454437] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.454533] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.454649] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.455655] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.466374] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.466622] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.467614] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.467687] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.467756] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.467825] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.467893] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.467961] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.468029] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.468097] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.468164] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.468230] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.468297] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.468363] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.468434] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.468500] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.468568] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.468634] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.468700] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.468766] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.468833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.468907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.468982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.469053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.469125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.469193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.469262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.469331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.469399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.469478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.469550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.469621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.469693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.469765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.469843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.469919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.469998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.470074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.470147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.470217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.470288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.470357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.470431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.470501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.470571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.470639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.470711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.470779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.470848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.470919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.470992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.471062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.471132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.471204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.471272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.471342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.471413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.471497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.471567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.471637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.471708] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.471811] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.471815] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56150, lrc_seqno=56150, guc_id=0, flags=0x73 in no process [-1] <7> [233.471817] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.471877] ------------[ cut here ]------------ <4> [233.471878] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.471880] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:47/3221 <4> [233.471944] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.472004] efi_pstore nfnetlink autofs4 <4> [233.472008] CPU: 4 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.472011] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.472013] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.472014] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.472019] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.472083] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.472085] RSP: 0018:ffffc90007163ca0 EFLAGS: 00010246 <4> [233.472087] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.472088] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.472089] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.472090] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.472091] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.472093] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [233.472094] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.472095] CR2: 000072a0f00740e8 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [233.472097] PKRU: 55555554 <4> [233.472098] Call Trace: <4> [233.472099] <TASK> <4> [233.472102] ? lock_sync+0x100/0x100 <4> [233.472106] ? lock_release+0xd0/0x2b0 <4> [233.472111] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.472116] process_one_work+0x239/0x760 <4> [233.472121] worker_thread+0x200/0x3f0 <4> [233.472124] ? __pfx_worker_thread+0x10/0x10 <4> [233.472126] kthread+0x10d/0x150 <4> [233.472129] ? __pfx_kthread+0x10/0x10 <4> [233.472132] ret_from_fork+0x3d4/0x480 <4> [233.472134] ? __pfx_kthread+0x10/0x10 <4> [233.472137] ret_from_fork_asm+0x1a/0x30 <4> [233.472143] </TASK> <4> [233.472145] irq event stamp: 440065 <4> [233.472146] hardirqs last enabled at (440071): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.472148] hardirqs last disabled at (440076): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.472150] softirqs last enabled at (439204): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.472152] softirqs last disabled at (439199): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.472154] ---[ end trace 0000000000000000 ]--- <5> [233.473495] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56205, lrc_seqno=56205, guc_id=0, flags=0x73 in no process [-1] <7> [233.473498] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.473560] ------------[ cut here ]------------ <4> [233.473562] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.473563] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:47/3221 <4> [233.473632] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.473693] efi_pstore nfnetlink autofs4 <4> [233.473697] CPU: 4 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.473700] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.473701] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.473702] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.473707] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.473774] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.473776] RSP: 0018:ffffc90007163ca0 EFLAGS: 00010246 <4> [233.473778] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.473779] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.473781] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.473782] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.473783] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.473784] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [233.473785] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.473787] CR2: 000072a0f00740e8 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [233.473788] PKRU: 55555554 <4> [233.473789] Call Trace: <4> [233.473790] <TASK> <4> [233.473794] ? lock_sync+0x100/0x100 <4> [233.473798] ? lock_release+0xd0/0x2b0 <4> [233.473803] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.473809] process_one_work+0x239/0x760 <4> [233.473814] worker_thread+0x200/0x3f0 <4> [233.473817] ? __pfx_worker_thread+0x10/0x10 <4> [233.473819] kthread+0x10d/0x150 <4> [233.473822] ? __pfx_kthread+0x10/0x10 <4> [233.473826] ret_from_fork+0x3d4/0x480 <4> [233.473828] ? __pfx_kthread+0x10/0x10 <4> [233.473831] ret_from_fork_asm+0x1a/0x30 <4> [233.473838] </TASK> <4> [233.473839] irq event stamp: 441627 <4> [233.473841] hardirqs last enabled at (441633): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.473843] hardirqs last disabled at (441638): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.473845] softirqs last enabled at (439204): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.473848] softirqs last disabled at (439199): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.473850] ---[ end trace 0000000000000000 ]--- <6> [233.473852] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.473920] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.473926] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.473938] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.474040] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.474144] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.474363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.474471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.474568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.474662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.474753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.474845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.474936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.475030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.475123] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.475225] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.475347] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.476358] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.486445] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.486698] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.487710] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.487796] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.487877] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.487959] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.488039] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.488119] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.488200] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.488279] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.488359] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.488446] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.488528] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.488609] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.488688] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.488766] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.488845] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.488924] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.489001] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.489078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.489156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.489245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.489333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.489416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.489506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.489587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.489669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.489751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.489832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.489915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.489999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.490082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.490166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.490252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.490343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.490433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.490534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.490621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.490707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.490788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.490870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.490955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.491041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.491125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.491208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.491289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.491375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.491460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.491541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.491621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.491701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.491782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.491866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.491953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.492036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.492118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.492200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.492283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.492363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.492447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.492531] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.492646] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.492650] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56205, lrc_seqno=56205, guc_id=0, flags=0x73 in no process [-1] <7> [233.492652] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.492713] ------------[ cut here ]------------ <4> [233.492715] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.492717] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:42/3216 <4> [233.492793] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.492867] efi_pstore nfnetlink autofs4 <4> [233.492873] CPU: 7 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.492876] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.492878] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.492879] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.492885] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.492961] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.492963] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [233.492965] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.492967] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.492968] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.492969] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.492971] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.492972] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000 <4> [233.492974] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.492975] CR2: 0000738bc0802898 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [233.492977] PKRU: 55555554 <4> [233.492978] Call Trace: <4> [233.492979] <TASK> <4> [233.492983] ? lock_sync+0x100/0x100 <4> [233.492987] ? lock_release+0xd0/0x2b0 <4> [233.492993] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.492998] process_one_work+0x239/0x760 <4> [233.493005] worker_thread+0x200/0x3f0 <4> [233.493008] ? __pfx_worker_thread+0x10/0x10 <4> [233.493010] kthread+0x10d/0x150 <4> [233.493013] ? __pfx_kthread+0x10/0x10 <4> [233.493017] ret_from_fork+0x3d4/0x480 <4> [233.493019] ? __pfx_kthread+0x10/0x10 <4> [233.493022] ret_from_fork_asm+0x1a/0x30 <4> [233.493029] </TASK> <4> [233.493031] irq event stamp: 1288571 <4> [233.493032] hardirqs last enabled at (1288577): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.493035] hardirqs last disabled at (1288582): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.493037] softirqs last enabled at (1287642): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.493039] softirqs last disabled at (1287637): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.493042] ---[ end trace 0000000000000000 ]--- <6> [233.493044] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.493118] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.493123] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.493536] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.493742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.493836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.493933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.494026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.494122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.494213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.494303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.494395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.494490] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.494591] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.494712] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.495735] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.506464] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.506717] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.507714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.507799] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.507879] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.507960] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.508041] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.508122] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.508202] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.508282] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.508361] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.508440] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.508532] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.508612] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.508690] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.508770] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.508848] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.508927] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.509006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.509084] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.509163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.509249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.509335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.509420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.509516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.509599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.509682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.509764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.509845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.509927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.510011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.510093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.510176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.510261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.510354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.510445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.510546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.510632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.510715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.510795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.510877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.510957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.511040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.511123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.511210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.511295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.511381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.511467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.511550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.511631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.511714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.511794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.511874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.511958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.512039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.512120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.512202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.512287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.512370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.512452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.512551] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.512666] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.512671] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56205, lrc_seqno=56205, guc_id=0, flags=0x73 in no process [-1] <7> [233.512673] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.512735] ------------[ cut here ]------------ <4> [233.512736] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.512738] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:42/3216 <4> [233.512814] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.512876] efi_pstore nfnetlink autofs4 <4> [233.512880] CPU: 7 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.512883] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.512885] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.512886] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.512891] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.512964] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.512966] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [233.512968] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.512969] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.512971] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.512972] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.512973] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.512974] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000 <4> [233.512976] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.512977] CR2: 0000738bc0802898 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [233.512979] PKRU: 55555554 <4> [233.512980] Call Trace: <4> [233.512981] <TASK> <4> [233.512985] ? lock_sync+0x100/0x100 <4> [233.512989] ? lock_release+0xd0/0x2b0 <4> [233.512995] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.513000] process_one_work+0x239/0x760 <4> [233.513006] worker_thread+0x200/0x3f0 <4> [233.513009] ? __pfx_worker_thread+0x10/0x10 <4> [233.513011] kthread+0x10d/0x150 <4> [233.513014] ? __pfx_kthread+0x10/0x10 <4> [233.513018] ret_from_fork+0x3d4/0x480 <4> [233.513020] ? __pfx_kthread+0x10/0x10 <4> [233.513023] ret_from_fork_asm+0x1a/0x30 <4> [233.513030] </TASK> <4> [233.513031] irq event stamp: 1291691 <4> [233.513032] hardirqs last enabled at (1291697): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.513035] hardirqs last disabled at (1291702): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.513037] softirqs last enabled at (1290848): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.513040] softirqs last disabled at (1290837): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.513042] ---[ end trace 0000000000000000 ]--- <5> [233.514389] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56260, lrc_seqno=56260, guc_id=0, flags=0x73 in no process [-1] <7> [233.514392] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.514466] ------------[ cut here ]------------ <4> [233.514468] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.514469] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:42/3216 <4> [233.514544] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.514620] efi_pstore nfnetlink autofs4 <4> [233.514625] CPU: 7 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.514627] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.514629] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.514630] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.514636] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.514708] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.514709] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [233.514712] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.514713] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.514714] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.514715] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.514717] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.514718] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000 <4> [233.514719] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.514721] CR2: 0000738bc0802898 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [233.514722] PKRU: 55555554 <4> [233.514723] Call Trace: <4> [233.514724] <TASK> <4> [233.514728] ? lock_sync+0x100/0x100 <4> [233.514732] ? lock_release+0xd0/0x2b0 <4> [233.514738] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.514743] process_one_work+0x239/0x760 <4> [233.514749] worker_thread+0x200/0x3f0 <4> [233.514752] ? __pfx_worker_thread+0x10/0x10 <4> [233.514754] kthread+0x10d/0x150 <4> [233.514757] ? __pfx_kthread+0x10/0x10 <4> [233.514761] ret_from_fork+0x3d4/0x480 <4> [233.514763] ? __pfx_kthread+0x10/0x10 <4> [233.514766] ret_from_fork_asm+0x1a/0x30 <4> [233.514774] </TASK> <4> [233.514775] irq event stamp: 1293809 <4> [233.514776] hardirqs last enabled at (1293815): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.514778] hardirqs last disabled at (1293820): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.514781] softirqs last enabled at (1293048): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.514783] softirqs last disabled at (1293041): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.514786] ---[ end trace 0000000000000000 ]--- <6> [233.514787] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.514860] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.514866] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.515068] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.515176] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.515666] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.515885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.515978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.516074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.516166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.516261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.516354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.516446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.516549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.516636] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.516736] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.516858] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.517867] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.528475] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.528731] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.529747] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.529825] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.529899] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.529974] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.530051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.530125] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.530200] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.530274] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.530346] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.530418] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.530500] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.530579] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.530657] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.530737] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.530817] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.530897] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.530975] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.531055] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.531132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.531218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.531308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.531394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.531481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.531564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.531645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.531725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.531805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.531888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.531971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.532052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.532135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.532218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.532306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.532399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.532494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.532582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.532668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.532753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.532838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.532918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.533002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.533082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.533164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.533246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.533332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.533414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.533498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.533578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.533660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.533739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.533819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.533901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.533983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.534070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.534154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.534238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.534319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.534399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.534488] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.534603] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.534607] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56260, lrc_seqno=56260, guc_id=0, flags=0x73 in no process [-1] <7> [233.534609] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.534671] ------------[ cut here ]------------ <4> [233.534672] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.534674] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:42/3216 <4> [233.534750] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.534812] efi_pstore nfnetlink autofs4 <4> [233.534817] CPU: 7 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.534821] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.534822] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.534823] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.534829] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.534905] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.534907] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [233.534909] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.534911] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.534912] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.534913] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.534915] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.534916] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000 <4> [233.534918] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.534919] CR2: 0000738bc0802898 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [233.534920] PKRU: 55555554 <4> [233.534922] Call Trace: <4> [233.534923] <TASK> <4> [233.534926] ? lock_sync+0x100/0x100 <4> [233.534931] ? lock_release+0xd0/0x2b0 <4> [233.534936] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.534942] process_one_work+0x239/0x760 <4> [233.534948] worker_thread+0x200/0x3f0 <4> [233.534951] ? __pfx_worker_thread+0x10/0x10 <4> [233.534953] kthread+0x10d/0x150 <4> [233.534956] ? __pfx_kthread+0x10/0x10 <4> [233.534960] ret_from_fork+0x3d4/0x480 <4> [233.534962] ? __pfx_kthread+0x10/0x10 <4> [233.534965] ret_from_fork_asm+0x1a/0x30 <4> [233.534973] </TASK> <4> [233.534974] irq event stamp: 1296917 <4> [233.534975] hardirqs last enabled at (1296923): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.534978] hardirqs last disabled at (1296928): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.534980] softirqs last enabled at (1296074): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.534982] softirqs last disabled at (1296063): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.534985] ---[ end trace 0000000000000000 ]--- <6> [233.534986] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.535062] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.535068] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.536308] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.536423] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.536546] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.536756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.536849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.536943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.537031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.537118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.537204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.537289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.537374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.537455] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.537570] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.537695] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.538718] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.548490] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.548739] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.549687] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.549778] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.549854] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.549931] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.550006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.550085] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.550162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.550239] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.550313] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.550386] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.550458] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.550546] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.550629] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.550704] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.550776] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.550850] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.550923] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.550996] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.551069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.551152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.551233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.551315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.551397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.551475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.551571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.551659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.551735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.551815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.551898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.551979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.552059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.552139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.552223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.552307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.552390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.552471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.552572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.552661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.552740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.552816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.552894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.552971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.553048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.553122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.553202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.553277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.553353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.553430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.553521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.553609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.553685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.553764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.553841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.553920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.553996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.554075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.554154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.554232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.554311] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.554423] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.554427] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56260, lrc_seqno=56260, guc_id=0, flags=0x73 in no process [-1] <7> [233.554430] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.554500] ------------[ cut here ]------------ <4> [233.554502] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.554505] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:48/3222 <4> [233.554588] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.554655] efi_pstore nfnetlink autofs4 <4> [233.554661] CPU: 8 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.554664] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.554666] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.554667] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.554673] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.554744] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.554747] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [233.554749] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.554751] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.554753] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.554754] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.554755] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.554757] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [233.554759] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.554761] CR2: 0000738bc2004f58 CR3: 0000000122082002 CR4: 0000000000f72ef0 <4> [233.554762] PKRU: 55555554 <4> [233.554764] Call Trace: <4> [233.554765] <TASK> <4> [233.554769] ? lock_sync+0x100/0x100 <4> [233.554774] ? lock_release+0xd0/0x2b0 <4> [233.554780] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.554786] process_one_work+0x239/0x760 <4> [233.554793] worker_thread+0x200/0x3f0 <4> [233.554795] ? __pfx_worker_thread+0x10/0x10 <4> [233.554798] kthread+0x10d/0x150 <4> [233.554801] ? __pfx_kthread+0x10/0x10 <4> [233.554805] ret_from_fork+0x3d4/0x480 <4> [233.554807] ? __pfx_kthread+0x10/0x10 <4> [233.554811] ret_from_fork_asm+0x1a/0x30 <4> [233.554818] </TASK> <4> [233.554820] irq event stamp: 361257 <4> [233.554821] hardirqs last enabled at (361263): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.554823] hardirqs last disabled at (361268): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.554826] softirqs last enabled at (360496): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.554828] softirqs last disabled at (360473): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.554830] ---[ end trace 0000000000000000 ]--- <5> [233.556361] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56315, lrc_seqno=56315, guc_id=0, flags=0x73 in no process [-1] <7> [233.556364] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.556429] ------------[ cut here ]------------ <4> [233.556430] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.556432] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:48/3222 <4> [233.556515] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.556590] efi_pstore nfnetlink autofs4 <4> [233.556595] CPU: 8 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.556598] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.556600] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.556601] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.556607] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.556677] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.556679] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [233.556681] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.556683] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.556684] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.556686] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.556688] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.556689] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [233.556691] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.556692] CR2: 0000738bc2004f58 CR3: 0000000122082002 CR4: 0000000000f72ef0 <4> [233.556694] PKRU: 55555554 <4> [233.556696] Call Trace: <4> [233.556697] <TASK> <4> [233.556701] ? lock_sync+0x100/0x100 <4> [233.556705] ? lock_release+0xd0/0x2b0 <4> [233.556711] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.556716] process_one_work+0x239/0x760 <4> [233.556723] worker_thread+0x200/0x3f0 <4> [233.556726] ? __pfx_worker_thread+0x10/0x10 <4> [233.556728] kthread+0x10d/0x150 <4> [233.556731] ? __pfx_kthread+0x10/0x10 <4> [233.556735] ret_from_fork+0x3d4/0x480 <4> [233.556737] ? __pfx_kthread+0x10/0x10 <4> [233.556741] ret_from_fork_asm+0x1a/0x30 <4> [233.556749] </TASK> <4> [233.556750] irq event stamp: 363909 <4> [233.556751] hardirqs last enabled at (363915): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.556754] hardirqs last disabled at (363920): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.556756] softirqs last enabled at (363166): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.556759] softirqs last disabled at (363155): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.556762] ---[ end trace 0000000000000000 ]--- <7> [233.556775] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.556880] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [233.556980] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.557049] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.557056] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.557275] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.557479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.557589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.557703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.557791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.557875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.557960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.558045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.558132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.558217] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.558312] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.558427] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.559441] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.570176] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.570426] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.571449] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.571541] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.571613] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.571683] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.571751] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.571821] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.571889] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.571957] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.572024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.572092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.572159] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.572225] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.572291] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.572357] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.572426] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.572496] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.572591] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.572678] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.572755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.572837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.572918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.572996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.573079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.573160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.573240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.573317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.573393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.573473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.573566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.573654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.573736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.573817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.573902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.573986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.574069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.574149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.574228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.574305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.574381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.574456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.574547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.574635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.574711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.574786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.574864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.574943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.575023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.575101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.575178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.575253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.575329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.575407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.575483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.575574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.575661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.575739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.575820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.575899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.575980] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.576090] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.576095] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56315, lrc_seqno=56315, guc_id=0, flags=0x73 in no process [-1] <7> [233.576097] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.576157] ------------[ cut here ]------------ <4> [233.576158] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.576159] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:48/3222 <4> [233.576229] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.576291] efi_pstore nfnetlink autofs4 <4> [233.576295] CPU: 8 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.576298] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.576299] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.576301] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.576306] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.576374] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.576376] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [233.576378] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.576380] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.576381] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.576382] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.576383] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.576385] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [233.576386] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.576387] CR2: 0000738bc2004f58 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [233.576389] PKRU: 55555554 <4> [233.576390] Call Trace: <4> [233.576391] <TASK> <4> [233.576395] ? lock_sync+0x100/0x100 <4> [233.576399] ? lock_release+0xd0/0x2b0 <4> [233.576405] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.576410] process_one_work+0x239/0x760 <4> [233.576416] worker_thread+0x200/0x3f0 <4> [233.576419] ? __pfx_worker_thread+0x10/0x10 <4> [233.576421] kthread+0x10d/0x150 <4> [233.576424] ? __pfx_kthread+0x10/0x10 <4> [233.576428] ret_from_fork+0x3d4/0x480 <4> [233.576430] ? __pfx_kthread+0x10/0x10 <4> [233.576433] ret_from_fork_asm+0x1a/0x30 <4> [233.576440] </TASK> <4> [233.576442] irq event stamp: 367027 <4> [233.576443] hardirqs last enabled at (367033): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.576445] hardirqs last disabled at (367038): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.576448] softirqs last enabled at (365962): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.576450] softirqs last disabled at (365955): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.576452] ---[ end trace 0000000000000000 ]--- <6> [233.576454] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.577698] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.577704] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.577784] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.577888] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.577992] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.578200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.578291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.578386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.578477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.578577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.578663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.578747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.578834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.578915] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.579009] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.579126] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.580145] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.590522] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.590770] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.591723] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.591802] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.591877] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.591953] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.592029] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.592104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.592181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.592257] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.592332] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.592406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.592479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.592561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.592634] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.592708] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.592781] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.592854] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.592927] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.593000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.593076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.593159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.593241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.593320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.593399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.593476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.593562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.593639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.593716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.593796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.593876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.593954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.594035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.594118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.594203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.594287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.594371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.594455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.594543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.594623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.594701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.594777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.594858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.594935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.595015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.595094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.595176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.595254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.595331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.595406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.595483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.595567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.595642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.595721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.595796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.595873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.595954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.596034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.596115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.596195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.596277] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.596388] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.596392] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56315, lrc_seqno=56315, guc_id=0, flags=0x73 in no process [-1] <7> [233.596394] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.596452] ------------[ cut here ]------------ <4> [233.596453] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.596455] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:47/3221 <4> [233.596528] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.596592] efi_pstore nfnetlink autofs4 <4> [233.596596] CPU: 4 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.596599] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.596600] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.596602] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.596607] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.596676] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.596678] RSP: 0018:ffffc90007163ca0 EFLAGS: 00010246 <4> [233.596680] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.596682] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.596683] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.596684] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.596685] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.596687] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [233.596688] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.596690] CR2: 000072a0f00740e8 CR3: 0000000122082006 CR4: 0000000000f72ef0 <4> [233.596691] PKRU: 55555554 <4> [233.596692] Call Trace: <4> [233.596693] <TASK> <4> [233.596697] ? lock_sync+0x100/0x100 <4> [233.596701] ? lock_release+0xd0/0x2b0 <4> [233.596707] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.596712] process_one_work+0x239/0x760 <4> [233.596718] worker_thread+0x200/0x3f0 <4> [233.596721] ? __pfx_worker_thread+0x10/0x10 <4> [233.596724] kthread+0x10d/0x150 <4> [233.596727] ? __pfx_kthread+0x10/0x10 <4> [233.596730] ret_from_fork+0x3d4/0x480 <4> [233.596732] ? __pfx_kthread+0x10/0x10 <4> [233.596736] ret_from_fork_asm+0x1a/0x30 <4> [233.596743] </TASK> <4> [233.596744] irq event stamp: 447999 <4> [233.596745] hardirqs last enabled at (448005): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.596748] hardirqs last disabled at (448010): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.596750] softirqs last enabled at (447096): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.596753] softirqs last disabled at (447089): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.596755] ---[ end trace 0000000000000000 ]--- <5> [233.597373] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56370, lrc_seqno=56370, guc_id=0, flags=0x73 in no process [-1] <7> [233.597379] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.597549] ------------[ cut here ]------------ <4> [233.597551] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.597554] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:42/3216 <4> [233.597700] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.597772] efi_pstore nfnetlink autofs4 <4> [233.597778] CPU: 7 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.597781] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.597782] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.597784] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.597791] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.597875] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.597877] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [233.597879] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.597881] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.597882] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.597883] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.597884] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.597886] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000 <4> [233.597887] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.597889] CR2: 0000738bc0802898 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [233.597890] PKRU: 55555554 <4> [233.597891] Call Trace: <4> [233.597892] <TASK> <4> [233.597897] ? lock_sync+0x100/0x100 <4> [233.597902] ? lock_release+0xd0/0x2b0 <4> [233.597909] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.597914] process_one_work+0x239/0x760 <4> [233.597921] worker_thread+0x200/0x3f0 <4> [233.597923] ? __pfx_worker_thread+0x10/0x10 <4> [233.597926] kthread+0x10d/0x150 <4> [233.597930] ? __pfx_kthread+0x10/0x10 <4> [233.597933] ret_from_fork+0x3d4/0x480 <4> [233.597935] ? __pfx_kthread+0x10/0x10 <4> [233.597939] ret_from_fork_asm+0x1a/0x30 <4> [233.597946] </TASK> <4> [233.597948] irq event stamp: 1301659 <4> [233.597949] hardirqs last enabled at (1301665): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.597953] hardirqs last disabled at (1301670): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.597956] softirqs last enabled at (1300898): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.597958] softirqs last disabled at (1300893): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.597961] ---[ end trace 0000000000000000 ]--- <6> [233.597964] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.598040] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.598110] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.598260] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.598364] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.598470] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.598710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.598839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.598973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.599105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.599236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.599359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.599464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.599566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.599653] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.599753] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.599873] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.600958] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.611715] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.611968] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.613026] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.613107] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.613186] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.613263] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.613359] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.613475] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.613612] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.613722] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.613830] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.613942] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.614025] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.614103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.614181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.614257] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.614333] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.614448] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.614573] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.614684] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.614794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.614914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.615035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.615135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.615218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.615298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.615377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.615455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.615556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.615679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.615797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.615911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.616024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.616147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.616267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.616356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.616444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.616529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.616628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.616707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.616824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.616937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.617057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.617176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.617293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.617408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.617494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.617586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.617667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.617745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.617824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.617900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.617995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.618115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.618230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.618345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.618460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.618591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.618694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.618775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.618859] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.618974] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.618979] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56370, lrc_seqno=56370, guc_id=0, flags=0x73 in no process [-1] <7> [233.618981] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.619041] ------------[ cut here ]------------ <4> [233.619042] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.619043] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:42/3216 <4> [233.619126] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.619246] efi_pstore nfnetlink autofs4 <4> [233.619253] CPU: 7 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.619258] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.619260] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.619262] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.619271] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.619376] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.619379] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [233.619383] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.619386] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.619388] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.619390] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.619392] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.619395] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000 <4> [233.619397] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.619400] CR2: 0000738bc0802898 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [233.619402] PKRU: 55555554 <4> [233.619404] Call Trace: <4> [233.619406] <TASK> <4> [233.619413] ? lock_sync+0x100/0x100 <4> [233.619421] ? lock_release+0xd0/0x2b0 <4> [233.619430] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.619440] process_one_work+0x239/0x760 <4> [233.619451] worker_thread+0x200/0x3f0 <4> [233.619456] ? __pfx_worker_thread+0x10/0x10 <4> [233.619460] kthread+0x10d/0x150 <4> [233.619464] ? __pfx_kthread+0x10/0x10 <4> [233.619470] ret_from_fork+0x3d4/0x480 <4> [233.619473] ? __pfx_kthread+0x10/0x10 <4> [233.619479] ret_from_fork_asm+0x1a/0x30 <4> [233.619492] </TASK> <4> [233.619494] irq event stamp: 1304873 <4> [233.619496] hardirqs last enabled at (1304879): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.619500] hardirqs last disabled at (1304884): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.619504] softirqs last enabled at (1303878): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.619508] softirqs last disabled at (1303871): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.619511] ---[ end trace 0000000000000000 ]--- <6> [233.619514] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.619651] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.619660] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.620074] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.620298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.620390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.620484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.620610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.620734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.620856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.620983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.621111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.621236] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.621361] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.621480] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.622528] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.633332] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.633582] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.634636] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.634710] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.634781] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.634851] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.634919] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.634988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.635055] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.635121] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.635188] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.635256] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.635326] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.635394] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.635461] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.635529] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.635614] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.635687] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.635761] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.635834] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.635907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.635987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.636068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.636148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.636227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.636305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.636382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.636458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.636534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.636629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.636709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.636787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.636864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.636943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.637025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.637107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.637190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.637270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.637348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.637424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.637500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.637601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.637684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.637764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.637842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.637918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.637998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.638075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.638152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.638227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.638304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.638380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.638458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.638537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.638630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.638707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.638783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.638859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.638934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.639010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.639092] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.639203] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.639207] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56370, lrc_seqno=56370, guc_id=0, flags=0x73 in no process [-1] <7> [233.639210] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.639268] ------------[ cut here ]------------ <4> [233.639269] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.639271] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:42/3216 <4> [233.639341] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.639404] efi_pstore nfnetlink autofs4 <4> [233.639408] CPU: 7 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.639411] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.639412] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.639413] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.639419] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.639488] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.639490] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [233.639492] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.639493] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.639495] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.639496] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.639497] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.639498] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000 <4> [233.639500] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.639501] CR2: 0000738bc0802898 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [233.639503] PKRU: 55555554 <4> [233.639504] Call Trace: <4> [233.639505] <TASK> <4> [233.639509] ? lock_sync+0x100/0x100 <4> [233.639513] ? lock_release+0xd0/0x2b0 <4> [233.639519] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.639524] process_one_work+0x239/0x760 <4> [233.639531] worker_thread+0x200/0x3f0 <4> [233.639533] ? __pfx_worker_thread+0x10/0x10 <4> [233.639536] kthread+0x10d/0x150 <4> [233.639539] ? __pfx_kthread+0x10/0x10 <4> [233.639542] ret_from_fork+0x3d4/0x480 <4> [233.639544] ? __pfx_kthread+0x10/0x10 <4> [233.639553] ret_from_fork_asm+0x1a/0x30 <4> [233.639560] </TASK> <4> [233.639561] irq event stamp: 1307981 <4> [233.639563] hardirqs last enabled at (1307987): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.639566] hardirqs last disabled at (1307992): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.639569] softirqs last enabled at (1307008): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.639571] softirqs last disabled at (1307001): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.639574] ---[ end trace 0000000000000000 ]--- <7> [233.641086] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.641190] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [233.641288] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56425, lrc_seqno=56425, guc_id=0, flags=0x73 in no process [-1] <7> [233.641290] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.641349] ------------[ cut here ]------------ <4> [233.641350] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.641351] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:42/3216 <4> [233.641421] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.641482] efi_pstore nfnetlink autofs4 <4> [233.641486] CPU: 7 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.641489] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.641490] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.641491] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.641496] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.641572] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.641574] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [233.641576] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.641578] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.641579] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.641581] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.641582] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.641584] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000 <4> [233.641585] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.641587] CR2: 0000738bc0802898 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [233.641588] PKRU: 55555554 <4> [233.641589] Call Trace: <4> [233.641590] <TASK> <4> [233.641594] ? lock_sync+0x100/0x100 <4> [233.641598] ? lock_release+0xd0/0x2b0 <4> [233.641603] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.641609] process_one_work+0x239/0x760 <4> [233.641615] worker_thread+0x200/0x3f0 <4> [233.641618] ? __pfx_worker_thread+0x10/0x10 <4> [233.641621] kthread+0x10d/0x150 <4> [233.641624] ? __pfx_kthread+0x10/0x10 <4> [233.641628] ret_from_fork+0x3d4/0x480 <4> [233.641630] ? __pfx_kthread+0x10/0x10 <4> [233.641634] ret_from_fork_asm+0x1a/0x30 <4> [233.641641] </TASK> <4> [233.641643] irq event stamp: 1310681 <4> [233.641644] hardirqs last enabled at (1310687): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.641647] hardirqs last disabled at (1310692): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.641650] softirqs last enabled at (1307008): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.641652] softirqs last disabled at (1307001): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.641655] ---[ end trace 0000000000000000 ]--- <6> [233.641657] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.641728] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.641735] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.641782] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.641988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.642079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.642173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.642262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.642348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.642433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.642518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.642615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.642698] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.642793] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.642911] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.643917] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.654568] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.654818] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.655826] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.655905] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.655981] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.656059] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.656136] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.656211] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.656288] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.656364] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.656441] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.656518] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.656601] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.656676] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.656749] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.656824] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.656898] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.656973] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.657050] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.657124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.657199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.657281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.657362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.657442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.657521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.657605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.657681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.657757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.657832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.657911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.657991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.658068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.658145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.658225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.658308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.658392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.658475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.658555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.658680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.658756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.658833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.658910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.658988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.659065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.659144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.659221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.659300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.659375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.659452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.659527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.659611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.659686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.659761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.659840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.659921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.660002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.660080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.660158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.660234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.660311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.660390] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.660501] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.660505] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56425, lrc_seqno=56425, guc_id=0, flags=0x73 in no process [-1] <7> [233.660507] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.660570] ------------[ cut here ]------------ <4> [233.660571] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.660572] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:47/3221 <4> [233.660644] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.660706] efi_pstore nfnetlink autofs4 <4> [233.660710] CPU: 4 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.660713] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.660714] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.660716] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.660721] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.660790] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.660792] RSP: 0018:ffffc90007163ca0 EFLAGS: 00010246 <4> [233.660795] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.660796] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.660798] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.660799] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.660801] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.660802] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [233.660804] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.660806] CR2: 000072a0f00740e8 CR3: 0000000122082006 CR4: 0000000000f72ef0 <4> [233.660808] PKRU: 55555554 <4> [233.660809] Call Trace: <4> [233.660810] <TASK> <4> [233.660815] ? lock_sync+0x100/0x100 <4> [233.660819] ? lock_release+0xd0/0x2b0 <4> [233.660825] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.660831] process_one_work+0x239/0x760 <4> [233.660837] worker_thread+0x200/0x3f0 <4> [233.660840] ? __pfx_worker_thread+0x10/0x10 <4> [233.660843] kthread+0x10d/0x150 <4> [233.660846] ? __pfx_kthread+0x10/0x10 <4> [233.660850] ret_from_fork+0x3d4/0x480 <4> [233.660852] ? __pfx_kthread+0x10/0x10 <4> [233.660855] ret_from_fork_asm+0x1a/0x30 <4> [233.660863] </TASK> <4> [233.660864] irq event stamp: 456253 <4> [233.660865] hardirqs last enabled at (456259): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.660868] hardirqs last disabled at (456264): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.660871] softirqs last enabled at (455344): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.660873] softirqs last disabled at (455337): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.660876] ---[ end trace 0000000000000000 ]--- <6> [233.660878] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.660947] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.660953] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.662137] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.662242] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.662347] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.662556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.662679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.662777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.662865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.662951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.663035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.663119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.663208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.663293] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.663389] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.663505] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.664516] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.674590] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.674838] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.675830] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.675925] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.676010] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.676086] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.676162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.676236] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.676310] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.676385] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.676459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.676534] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.676622] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.676707] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.676782] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.676856] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.676929] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.677006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.677082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.677158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.677234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.677315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.677396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.677473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.677552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.677642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.677732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.677811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.677888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.677967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.678047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.678125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.678204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.678282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.678364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.678448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.678530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.678622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.678710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.678785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.678861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.678938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.679019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.679098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.679175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.679252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.679337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.679415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.679492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.679569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.679663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.679749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.679825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.679907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.679986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.680065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.680143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.680220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.680298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.680374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.680453] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.680565] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.680569] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56425, lrc_seqno=56425, guc_id=0, flags=0x73 in no process [-1] <7> [233.680572] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.680656] ------------[ cut here ]------------ <4> [233.680659] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.680661] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:48/3222 <4> [233.680745] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.680821] efi_pstore nfnetlink autofs4 <4> [233.680827] CPU: 8 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.680830] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.680832] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.680833] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.680839] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.680909] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.680911] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [233.680913] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.680915] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.680917] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.680918] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.680920] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.680921] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [233.680923] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.680925] CR2: 0000738bc2004f58 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [233.680927] PKRU: 55555554 <4> [233.680928] Call Trace: <4> [233.680929] <TASK> <4> [233.680933] ? lock_sync+0x100/0x100 <4> [233.680938] ? lock_release+0xd0/0x2b0 <4> [233.680944] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.680950] process_one_work+0x239/0x760 <4> [233.680956] worker_thread+0x200/0x3f0 <4> [233.680959] ? __pfx_worker_thread+0x10/0x10 <4> [233.680962] kthread+0x10d/0x150 <4> [233.680965] ? __pfx_kthread+0x10/0x10 <4> [233.680969] ret_from_fork+0x3d4/0x480 <4> [233.680971] ? __pfx_kthread+0x10/0x10 <4> [233.680974] ret_from_fork_asm+0x1a/0x30 <4> [233.680982] </TASK> <4> [233.680983] irq event stamp: 371165 <4> [233.680984] hardirqs last enabled at (371171): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.680987] hardirqs last disabled at (371176): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.680989] softirqs last enabled at (370404): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.680992] softirqs last disabled at (370399): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.680994] ---[ end trace 0000000000000000 ]--- <5> [233.681848] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56480, lrc_seqno=56480, guc_id=0, flags=0x73 in no process [-1] <7> [233.681855] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.681956] ------------[ cut here ]------------ <4> [233.681958] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.681960] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:42/3216 <4> [233.682031] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.682134] efi_pstore nfnetlink autofs4 <4> [233.682139] CPU: 7 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.682142] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.682143] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.682145] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.682150] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.682219] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.682221] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [233.682223] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.682224] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.682225] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.682227] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.682228] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.682229] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000 <4> [233.682230] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.682232] CR2: 0000738bc0802898 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [233.682233] PKRU: 55555554 <4> [233.682234] Call Trace: <4> [233.682235] <TASK> <4> [233.682241] ? lock_sync+0x100/0x100 <4> [233.682245] ? lock_release+0xd0/0x2b0 <4> [233.682250] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.682256] process_one_work+0x239/0x760 <4> [233.682262] worker_thread+0x200/0x3f0 <4> [233.682264] ? __pfx_worker_thread+0x10/0x10 <4> [233.682267] kthread+0x10d/0x150 <4> [233.682269] ? __pfx_kthread+0x10/0x10 <7> [233.682220] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [233.682273] ret_from_fork+0x3d4/0x480 <4> [233.682275] ? __pfx_kthread+0x10/0x10 <4> [233.682278] ret_from_fork_asm+0x1a/0x30 <4> [233.682285] </TASK> <4> [233.682286] irq event stamp: 1313451 <4> [233.682287] hardirqs last enabled at (1313457): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.682289] hardirqs last disabled at (1313462): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.682291] softirqs last enabled at (1312062): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.682293] softirqs last disabled at (1312057): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.682295] ---[ end trace 0000000000000000 ]--- <6> [233.682297] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.682365] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.682371] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.682327] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.682507] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.682716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.682807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.682900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.682987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.683073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.683156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.683245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.683334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.683417] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.683512] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.683643] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.684652] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.694599] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.694850] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.695866] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.695946] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.696022] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.696098] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.696172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.696248] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.696322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.696397] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.696475] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.696551] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.696637] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.696712] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.696786] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.696862] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.696940] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.697016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.697092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.697166] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.697241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.697321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.697401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.697478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.697560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.697646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.697729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.697809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.697886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.697965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.698044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.698120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.698202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.698283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.698367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.698450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.698532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.698619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.698701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.698779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.698857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.698935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.699014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.699090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.699166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.699241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.699321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.699397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.699476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.699556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.699645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.699721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.699798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.699879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.699958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.700037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.700115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.700193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.700268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.700342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.700421] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.700531] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.700535] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56480, lrc_seqno=56480, guc_id=0, flags=0x73 in no process [-1] <7> [233.700537] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.700600] ------------[ cut here ]------------ <4> [233.700601] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.700603] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:47/3221 <4> [233.700673] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.700735] efi_pstore nfnetlink autofs4 <4> [233.700739] CPU: 4 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.700742] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.700743] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.700745] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.700750] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.700818] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.700820] RSP: 0018:ffffc90007163ca0 EFLAGS: 00010246 <4> [233.700823] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.700824] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.700826] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.700828] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.700829] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.700830] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [233.700832] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.700834] CR2: 000072a0f00740e8 CR3: 0000000122082006 CR4: 0000000000f72ef0 <4> [233.700835] PKRU: 55555554 <4> [233.700837] Call Trace: <4> [233.700838] <TASK> <4> [233.700842] ? lock_sync+0x100/0x100 <4> [233.700847] ? lock_release+0xd0/0x2b0 <4> [233.700852] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.700858] process_one_work+0x239/0x760 <4> [233.700864] worker_thread+0x200/0x3f0 <4> [233.700868] ? __pfx_worker_thread+0x10/0x10 <4> [233.700870] kthread+0x10d/0x150 <4> [233.700873] ? __pfx_kthread+0x10/0x10 <4> [233.700877] ret_from_fork+0x3d4/0x480 <4> [233.700879] ? __pfx_kthread+0x10/0x10 <4> [233.700883] ret_from_fork_asm+0x1a/0x30 <4> [233.700890] </TASK> <4> [233.700892] irq event stamp: 461867 <4> [233.700893] hardirqs last enabled at (461873): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.700896] hardirqs last disabled at (461878): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.700899] softirqs last enabled at (461106): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.700901] softirqs last disabled at (461099): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.700904] ---[ end trace 0000000000000000 ]--- <6> [233.700906] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.700976] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.700982] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.701989] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.702095] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.702200] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.702407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.702499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.702599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.702697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.702784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.702872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.702960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.703049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.703133] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.703229] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.703346] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.704358] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.714954] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.715197] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.716200] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.716272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.716341] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.716411] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.716480] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.716549] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.716624] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.716707] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.716785] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.716861] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.716937] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.717011] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.717085] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.717158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.717232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.717305] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.717379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.717453] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.717526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.717614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.717707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.717788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.717868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.717946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.718023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.718098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.718174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.718252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.718330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.718408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.718489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.718568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.718664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.718757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.718841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.718925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.719008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.719087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.719164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.719241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.719324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.719404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.719483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.719559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.719652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.719738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.719815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.719890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.719966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.720040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.720115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.720197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.720278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.720357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.720434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.720511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.720586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.720673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.720763] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.720875] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.720880] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56480, lrc_seqno=56480, guc_id=0, flags=0x73 in no process [-1] <7> [233.720882] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.720940] ------------[ cut here ]------------ <4> [233.720941] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.720943] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:48/3222 <4> [233.721014] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.721090] efi_pstore nfnetlink autofs4 <4> [233.721095] CPU: 8 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.721098] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.721100] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.721102] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.721107] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.721177] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.721179] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [233.721181] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.721182] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.721184] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.721185] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.721186] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.721187] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000 <4> [233.721189] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.721190] CR2: 0000738bc2004f58 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [233.721192] PKRU: 55555554 <4> [233.721193] Call Trace: <4> [233.721194] <TASK> <4> [233.721198] ? lock_sync+0x100/0x100 <4> [233.721203] ? lock_release+0xd0/0x2b0 <4> [233.721208] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.721214] process_one_work+0x239/0x760 <4> [233.721220] worker_thread+0x200/0x3f0 <4> [233.721222] ? __pfx_worker_thread+0x10/0x10 <4> [233.721225] kthread+0x10d/0x150 <4> [233.721228] ? __pfx_kthread+0x10/0x10 <4> [233.721231] ret_from_fork+0x3d4/0x480 <4> [233.721233] ? __pfx_kthread+0x10/0x10 <4> [233.721237] ret_from_fork_asm+0x1a/0x30 <4> [233.721244] </TASK> <4> [233.721245] irq event stamp: 374761 <4> [233.721247] hardirqs last enabled at (374767): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.721249] hardirqs last disabled at (374772): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.721252] softirqs last enabled at (373638): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.721254] softirqs last disabled at (373633): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.721257] ---[ end trace 0000000000000000 ]--- <5> [233.722677] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56535, lrc_seqno=56535, guc_id=0, flags=0x73 in no process [-1] <7> [233.722686] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.722821] ------------[ cut here ]------------ <4> [233.722824] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.722826] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#12: kworker/u64:48/3222 <7> [233.722852] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <4> [233.722944] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video <7> [233.722960] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <4> [233.723009] snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 <4> [233.723046] CPU: 12 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.723050] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.723052] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.723054] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.723062] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.723177] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.723179] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [233.723182] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.723185] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.723187] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.723188] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.723190] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.723192] FS: 0000000000000000(0000) GS:ffff8888db297000(0000) knlGS:0000000000000000 <4> [233.723195] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.723197] CR2: 0000738bc28038d8 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [233.723199] PKRU: 55555554 <4> [233.723200] Call Trace: <4> [233.723202] <TASK> <4> [233.723209] ? lock_sync+0x100/0x100 <4> [233.723216] ? lock_release+0xd0/0x2b0 <4> [233.723224] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.723233] process_one_work+0x239/0x760 <4> [233.723244] worker_thread+0x200/0x3f0 <4> [233.723248] ? __pfx_worker_thread+0x10/0x10 <4> [233.723251] kthread+0x10d/0x150 <4> [233.723255] ? __pfx_kthread+0x10/0x10 <4> [233.723260] ret_from_fork+0x3d4/0x480 <4> [233.723263] ? __pfx_kthread+0x10/0x10 <4> [233.723268] ret_from_fork_asm+0x1a/0x30 <4> [233.723280] </TASK> <4> [233.723282] irq event stamp: 377383 <4> [233.723283] hardirqs last enabled at (377389): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.723287] hardirqs last disabled at (377394): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.723291] softirqs last enabled at (373638): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.723294] softirqs last disabled at (373633): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.723297] ---[ end trace 0000000000000000 ]--- <6> [233.723300] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.723413] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.723424] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.723475] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.723720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.723856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.723995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.724128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.724260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.724390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.724522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.724663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.724796] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.724939] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.725103] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.726476] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.736629] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.736940] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.738137] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.738259] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.738376] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.738496] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.738615] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.738743] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.738863] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.738982] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.739101] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.739220] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.739338] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.739457] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.739575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.739699] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.739818] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.739937] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.740056] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.740174] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.740292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.740417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.740541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.740667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.740792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.740913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.741035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.741157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.741279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.741404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.741530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.741659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.741785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.741911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.742041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.742171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.742301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.742428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.742555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.742683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.742807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.742928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.743055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.743179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.743303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.743425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.743552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.743692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.743783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.743866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.743948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.744027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.744105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.744184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.744262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.744341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.744418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.744496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.744572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.744685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.744812] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.744973] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.744980] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56535, lrc_seqno=56535, guc_id=0, flags=0x73 in no process [-1] <7> [233.744983] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.745084] ------------[ cut here ]------------ <4> [233.745085] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.745088] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#12: kworker/u64:48/3222 <4> [233.745199] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.745292] efi_pstore nfnetlink autofs4 <4> [233.745298] CPU: 12 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.745302] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.745304] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.745306] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.745314] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.745424] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.745426] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [233.745429] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.745431] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.745433] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.745435] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.745437] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.745439] FS: 0000000000000000(0000) GS:ffff8888db297000(0000) knlGS:0000000000000000 <4> [233.745441] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.745443] CR2: 0000738bc28038d8 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [233.745445] PKRU: 55555554 <4> [233.745447] Call Trace: <4> [233.745448] <TASK> <4> [233.745455] ? lock_sync+0x100/0x100 <4> [233.745461] ? lock_release+0xd0/0x2b0 <4> [233.745470] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.745479] process_one_work+0x239/0x760 <4> [233.745489] worker_thread+0x200/0x3f0 <4> [233.745494] ? __pfx_worker_thread+0x10/0x10 <4> [233.745497] kthread+0x10d/0x150 <4> [233.745501] ? __pfx_kthread+0x10/0x10 <4> [233.745506] ret_from_fork+0x3d4/0x480 <4> [233.745509] ? __pfx_kthread+0x10/0x10 <4> [233.745514] ret_from_fork_asm+0x1a/0x30 <4> [233.745526] </TASK> <4> [233.745528] irq event stamp: 380465 <4> [233.745529] hardirqs last enabled at (380471): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.745533] hardirqs last disabled at (380476): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.745536] softirqs last enabled at (379612): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.745539] softirqs last disabled at (379607): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.745542] ---[ end trace 0000000000000000 ]--- <6> [233.745545] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.747175] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.747185] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.747265] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.747419] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.747573] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.747827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.747956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.748090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.748220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.748350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.748479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.748609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.748746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.748874] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.749013] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.749176] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.750550] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.760645] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.760904] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.761919] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.762002] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.762080] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.762158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.762236] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.762313] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.762390] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.762465] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.762540] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.762617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.762707] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.762783] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.762859] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.762932] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.763006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.763080] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.763153] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.763227] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.763300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.763380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.763462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.763542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.763623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.763722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.763799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.763876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.763952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.764030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.764108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.764185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.764263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.764340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.764424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.764508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.764591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.764683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.764766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.764844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.764923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.765000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.765079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.765160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.765240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.765317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.765397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.765475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.765556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.765633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.765726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.765802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.765877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.765956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.766032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.766110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.766188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.766269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.766348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.766424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.766506] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.766622] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.766627] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56535, lrc_seqno=56535, guc_id=0, flags=0x73 in no process [-1] <7> [233.766629] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.766710] ------------[ cut here ]------------ <4> [233.766711] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.766713] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:48/3222 <4> [233.766784] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.766851] efi_pstore nfnetlink autofs4 <4> [233.766857] CPU: 6 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.766860] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.766862] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.766864] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.766869] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.766939] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.766941] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [233.766943] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.766945] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.766946] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.766947] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.766949] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.766950] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [233.766952] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.766953] CR2: 000070b5c344e008 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [233.766954] PKRU: 55555554 <4> [233.766956] Call Trace: <4> [233.766957] <TASK> <4> [233.766961] ? lock_sync+0x100/0x100 <4> [233.766965] ? lock_release+0xd0/0x2b0 <4> [233.766971] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.766977] process_one_work+0x239/0x760 <4> [233.766983] worker_thread+0x200/0x3f0 <4> [233.766986] ? __pfx_worker_thread+0x10/0x10 <4> [233.766988] kthread+0x10d/0x150 <4> [233.766991] ? __pfx_kthread+0x10/0x10 <4> [233.766995] ret_from_fork+0x3d4/0x480 <4> [233.766997] ? __pfx_kthread+0x10/0x10 <4> [233.767000] ret_from_fork_asm+0x1a/0x30 <4> [233.767008] </TASK> <4> [233.767009] irq event stamp: 383621 <4> [233.767010] hardirqs last enabled at (383627): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.767013] hardirqs last disabled at (383632): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.767015] softirqs last enabled at (382618): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.767018] softirqs last disabled at (382611): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.767020] ---[ end trace 0000000000000000 ]--- <5> [233.768538] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56590, lrc_seqno=56590, guc_id=0, flags=0x73 in no process [-1] <7> [233.768541] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.768600] ------------[ cut here ]------------ <4> [233.768601] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.768603] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:48/3222 <4> [233.768690] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.768763] efi_pstore nfnetlink autofs4 <4> [233.768768] CPU: 6 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.768771] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.768772] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.768774] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.768779] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.768848] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.768850] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [233.768852] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.768854] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.768855] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.768857] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.768858] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.768860] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [233.768862] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.768863] CR2: 000070b5c344e008 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [233.768865] PKRU: 55555554 <4> [233.768866] Call Trace: <4> [233.768868] <TASK> <4> [233.768872] ? lock_sync+0x100/0x100 <4> [233.768876] ? lock_release+0xd0/0x2b0 <4> [233.768882] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.768888] process_one_work+0x239/0x760 <4> [233.768894] worker_thread+0x200/0x3f0 <4> [233.768897] ? __pfx_worker_thread+0x10/0x10 <4> [233.768900] kthread+0x10d/0x150 <4> [233.768903] ? __pfx_kthread+0x10/0x10 <4> [233.768906] ret_from_fork+0x3d4/0x480 <4> [233.768909] ? __pfx_kthread+0x10/0x10 <4> [233.768912] ret_from_fork_asm+0x1a/0x30 <4> [233.768919] </TASK> <4> [233.768921] irq event stamp: 386027 <4> [233.768922] hardirqs last enabled at (386033): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.768925] hardirqs last disabled at (386038): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.768927] softirqs last enabled at (382618): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.768929] softirqs last disabled at (382611): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.768932] ---[ end trace 0000000000000000 ]--- <7> [233.768945] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.769050] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [233.769150] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.769239] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.769246] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.769480] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.769691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.769780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.769873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.769963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.770051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.770137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.770222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.770309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.770391] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.770487] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.770605] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.771639] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.781662] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.781912] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.782906] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.782986] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.783063] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.783140] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.783216] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.783290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.783364] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.783438] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.783511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.783585] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.783663] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.783737] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.783810] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.783884] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.783957] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.784031] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.784104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.784177] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.784251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.784332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.784415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.784492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.784571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.784645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.784737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.784817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.784895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.784974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.785074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.785165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.785242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.785321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.785404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.785488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.785576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.785663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.785744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.785822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.785900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.785975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.786052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.786133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.786213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.786292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.786373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.786449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.786527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.786603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.786688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.786764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.786839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.786918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.786994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.787070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.787145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.787222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.787299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.787379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.787460] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.787576] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.787580] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56590, lrc_seqno=56590, guc_id=0, flags=0x73 in no process [-1] <7> [233.787582] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.787640] ------------[ cut here ]------------ <4> [233.787642] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.787643] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:48/3222 <4> [233.787732] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.787803] efi_pstore nfnetlink autofs4 <4> [233.787813] CPU: 6 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.787818] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.787821] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.787824] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.787833] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.787917] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.787919] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [233.787922] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.787924] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.787925] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.787927] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.787928] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.787930] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [233.787931] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.787933] CR2: 000070b5c344e008 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [233.787935] PKRU: 55555554 <4> [233.787936] Call Trace: <4> [233.787938] <TASK> <4> [233.787942] ? lock_sync+0x100/0x100 <4> [233.787947] ? lock_release+0xd0/0x2b0 <4> [233.787954] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.787961] process_one_work+0x239/0x760 <4> [233.787968] worker_thread+0x200/0x3f0 <4> [233.787972] ? __pfx_worker_thread+0x10/0x10 <4> [233.787975] kthread+0x10d/0x150 <4> [233.787978] ? __pfx_kthread+0x10/0x10 <4> [233.787981] ret_from_fork+0x3d4/0x480 <4> [233.787983] ? __pfx_kthread+0x10/0x10 <4> [233.787986] ret_from_fork_asm+0x1a/0x30 <4> [233.787994] </TASK> <4> [233.787995] irq event stamp: 389127 <4> [233.787996] hardirqs last enabled at (389133): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.787998] hardirqs last disabled at (389138): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.788001] softirqs last enabled at (388384): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.788003] softirqs last disabled at (388373): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.788005] ---[ end trace 0000000000000000 ]--- <6> [233.789179] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.789259] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.789266] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.789320] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.789424] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.789530] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.789742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.789831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.789923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.790012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.790100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.790185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.790269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.790355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.790437] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.790532] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.790649] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.791673] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.801678] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.801929] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.802927] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.803006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.803104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.803193] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.803270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.803347] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.803424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.803502] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.803579] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.803655] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.803744] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.803819] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.803893] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.803967] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.804040] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.804112] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.804187] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.804261] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.804334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.804415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.804496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.804577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.804661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.804756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.804834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.804912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.804989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.805068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.805148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.805239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.805318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.805400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.805489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.805575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.805661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.805758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.805839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.805916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.805999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.806077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.806157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.806236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.806314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.806391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.806473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.806550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.806628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.806714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.806790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.806864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.806940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.807018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.807098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.807178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.807258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.807337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.807414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.807490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.807570] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.807689] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.807694] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56590, lrc_seqno=56590, guc_id=0, flags=0x73 in no process [-1] <7> [233.807696] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.807755] ------------[ cut here ]------------ <4> [233.807757] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.807759] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:48/3222 <4> [233.807829] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.807892] efi_pstore nfnetlink autofs4 <4> [233.807897] CPU: 6 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.807900] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.807901] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.807902] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.807908] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.807996] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.807998] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [233.808001] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.808002] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.808004] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.808006] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.808007] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.808009] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [233.808011] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.808012] CR2: 000070b5c344e008 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [233.808014] PKRU: 55555554 <4> [233.808015] Call Trace: <4> [233.808017] <TASK> <4> [233.808022] ? lock_sync+0x100/0x100 <4> [233.808027] ? lock_release+0xd0/0x2b0 <4> [233.808033] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.808041] process_one_work+0x239/0x760 <4> [233.808048] worker_thread+0x200/0x3f0 <4> [233.808051] ? __pfx_worker_thread+0x10/0x10 <4> [233.808053] kthread+0x10d/0x150 <4> [233.808056] ? __pfx_kthread+0x10/0x10 <4> [233.808060] ret_from_fork+0x3d4/0x480 <4> [233.808062] ? __pfx_kthread+0x10/0x10 <4> [233.808065] ret_from_fork_asm+0x1a/0x30 <4> [233.808072] </TASK> <4> [233.808073] irq event stamp: 392209 <4> [233.808074] hardirqs last enabled at (392215): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.808077] hardirqs last disabled at (392220): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.808080] softirqs last enabled at (391206): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.808082] softirqs last disabled at (391201): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.808084] ---[ end trace 0000000000000000 ]--- <5> [233.808866] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56645, lrc_seqno=56645, guc_id=0, flags=0x73 in no process [-1] <7> [233.808870] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.808987] ------------[ cut here ]------------ <4> [233.808988] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.808992] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:47/3221 <4> [233.809068] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.809140] efi_pstore nfnetlink autofs4 <4> [233.809145] CPU: 4 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.809148] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.809150] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.809151] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.809158] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.809234] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.809236] RSP: 0018:ffffc90007163ca0 EFLAGS: 00010246 <4> [233.809238] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.809240] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.809242] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.809243] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.809244] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.809245] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [233.809247] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.809248] CR2: 000072a0f00740e8 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [233.809250] PKRU: 55555554 <4> [233.809251] Call Trace: <4> [233.809252] <TASK> <4> [233.809258] ? lock_sync+0x100/0x100 <4> [233.809263] ? lock_release+0xd0/0x2b0 <4> [233.809269] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.809275] process_one_work+0x239/0x760 <4> [233.809282] worker_thread+0x200/0x3f0 <4> [233.809286] ? __pfx_worker_thread+0x10/0x10 <4> [233.809288] kthread+0x10d/0x150 <4> [233.809292] ? __pfx_kthread+0x10/0x10 <4> [233.809296] ret_from_fork+0x3d4/0x480 <4> [233.809298] ? __pfx_kthread+0x10/0x10 <4> [233.809302] ret_from_fork_asm+0x1a/0x30 <4> [233.809311] </TASK> <4> [233.809312] irq event stamp: 463859 <4> [233.809314] hardirqs last enabled at (463865): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.809317] hardirqs last disabled at (463870): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.809320] softirqs last enabled at (462954): [<ffffffff8133ac33>] kernel_fpu_end+0x53/0x70 <4> [233.809324] softirqs last disabled at (462952): [<ffffffff8133b344>] kernel_fpu_begin_mask+0xc4/0x120 <4> [233.809328] ---[ end trace 0000000000000000 ]--- <6> [233.809331] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.809410] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.809941] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.810059] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.810166] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.810272] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.810477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.810566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.810658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.810758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.810844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.810932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.811021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.811110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.811192] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.811285] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.811399] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.812406] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.823087] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.823358] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.824348] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.824427] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.824501] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.824577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.824651] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.824738] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.824818] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.824896] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.824976] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.825055] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.825135] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.825213] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.825292] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.825373] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.825454] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.825534] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.825613] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.825695] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.825777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.825864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.825952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.826037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.826123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.826204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.826285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.826364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.826444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.826527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.826611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.826697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.826781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.826862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.826955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.827049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.827142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.827231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.827316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.827397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.827480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.827560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.827643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.827732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.827813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.827893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.827980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.828066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.828151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.828234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.828318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.828398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.828479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.828563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.828643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.828733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.828814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.828897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.828978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.829058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.829141] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.829257] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.829262] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56645, lrc_seqno=56645, guc_id=0, flags=0x73 in no process [-1] <7> [233.829265] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.829327] ------------[ cut here ]------------ <4> [233.829328] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.829330] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:47/3221 <4> [233.829406] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.829471] efi_pstore nfnetlink autofs4 <4> [233.829476] CPU: 4 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.829479] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.829480] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.829482] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.829487] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.829560] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.829562] RSP: 0018:ffffc90007163ca0 EFLAGS: 00010246 <4> [233.829564] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.829566] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.829567] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.829568] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.829570] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.829571] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [233.829573] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.829574] CR2: 000072a0f00740e8 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [233.829575] PKRU: 55555554 <4> [233.829577] Call Trace: <4> [233.829578] <TASK> <4> [233.829582] ? lock_sync+0x100/0x100 <4> [233.829586] ? lock_release+0xd0/0x2b0 <4> [233.829592] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.829598] process_one_work+0x239/0x760 <4> [233.829604] worker_thread+0x200/0x3f0 <4> [233.829607] ? __pfx_worker_thread+0x10/0x10 <4> [233.829609] kthread+0x10d/0x150 <4> [233.829612] ? __pfx_kthread+0x10/0x10 <4> [233.829616] ret_from_fork+0x3d4/0x480 <4> [233.829618] ? __pfx_kthread+0x10/0x10 <4> [233.829621] ret_from_fork_asm+0x1a/0x30 <4> [233.829628] </TASK> <4> [233.829630] irq event stamp: 466969 <4> [233.829631] hardirqs last enabled at (466975): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.829634] hardirqs last disabled at (466980): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.829636] softirqs last enabled at (466096): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.829638] softirqs last disabled at (466089): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.829641] ---[ end trace 0000000000000000 ]--- <6> [233.829643] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.829727] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.829733] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.830141] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.830349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.830443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.830540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.830631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.830728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.830819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.830914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.831007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.831095] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.831194] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.831314] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.832337] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.843046] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.843292] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.844296] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.844374] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.844448] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.844522] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.844596] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.844671] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.844756] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.844836] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.844917] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.844995] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.845074] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.845152] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.845231] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.845309] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.845388] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.845469] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.845550] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.845630] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.845710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.845797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.845884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.845970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.846057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.846141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.846224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.846305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.846387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.846470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.846556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.846643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.846736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.846821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.846912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.847005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.847096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.847183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.847268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.847351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.847434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.847515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.847598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.847679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.847769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.847849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.847937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.848023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.848107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.848188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.848270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.848351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.848431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.848514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.848596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.848678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.848764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.848846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.848928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.849011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.849098] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.849212] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.849216] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56645, lrc_seqno=56645, guc_id=0, flags=0x73 in no process [-1] <7> [233.849218] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.849279] ------------[ cut here ]------------ <4> [233.849281] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.849282] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:47/3221 <4> [233.849359] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.849425] efi_pstore nfnetlink autofs4 <4> [233.849430] CPU: 4 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.849433] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.849434] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.849436] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.849441] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.849514] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.849516] RSP: 0018:ffffc90007163ca0 EFLAGS: 00010246 <4> [233.849518] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.849519] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.849521] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.849522] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.849523] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.849524] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [233.849526] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.849527] CR2: 000072a0f00740e8 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [233.849529] PKRU: 55555554 <4> [233.849530] Call Trace: <4> [233.849531] <TASK> <4> [233.849534] ? lock_sync+0x100/0x100 <4> [233.849539] ? lock_release+0xd0/0x2b0 <4> [233.849544] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.849550] process_one_work+0x239/0x760 <4> [233.849556] worker_thread+0x200/0x3f0 <4> [233.849559] ? __pfx_worker_thread+0x10/0x10 <4> [233.849561] kthread+0x10d/0x150 <4> [233.849564] ? __pfx_kthread+0x10/0x10 <4> [233.849568] ret_from_fork+0x3d4/0x480 <4> [233.849570] ? __pfx_kthread+0x10/0x10 <4> [233.849573] ret_from_fork_asm+0x1a/0x30 <4> [233.849581] </TASK> <4> [233.849582] irq event stamp: 470073 <4> [233.849583] hardirqs last enabled at (470079): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.849586] hardirqs last disabled at (470084): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.849588] softirqs last enabled at (469206): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.849590] softirqs last disabled at (469199): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.849593] ---[ end trace 0000000000000000 ]--- <7> [233.850973] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.851116] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [233.851412] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56700, lrc_seqno=56700, guc_id=0, flags=0x73 in no process [-1] <7> [233.851415] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.851476] ------------[ cut here ]------------ <4> [233.851477] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.851479] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:48/3222 <4> [233.851554] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.851620] efi_pstore nfnetlink autofs4 <4> [233.851625] CPU: 6 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.851629] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.851630] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.851632] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.851637] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.851713] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.851715] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [233.851717] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.851719] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.851720] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.851721] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.851723] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.851724] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [233.851725] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.851727] CR2: 000070b5c344e008 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [233.851728] PKRU: 55555554 <4> [233.851729] Call Trace: <4> [233.851730] <TASK> <4> [233.851734] ? lock_sync+0x100/0x100 <4> [233.851739] ? lock_release+0xd0/0x2b0 <4> [233.851744] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.851750] process_one_work+0x239/0x760 <4> [233.851756] worker_thread+0x200/0x3f0 <4> [233.851759] ? __pfx_worker_thread+0x10/0x10 <4> [233.851761] kthread+0x10d/0x150 <4> [233.851764] ? __pfx_kthread+0x10/0x10 <4> [233.851768] ret_from_fork+0x3d4/0x480 <4> [233.851770] ? __pfx_kthread+0x10/0x10 <4> [233.851774] ret_from_fork_asm+0x1a/0x30 <4> [233.851781] </TASK> <4> [233.851782] irq event stamp: 397577 <4> [233.851783] hardirqs last enabled at (397583): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.851786] hardirqs last disabled at (397588): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.851788] softirqs last enabled at (394802): [<ffffffff8133ac33>] kernel_fpu_end+0x53/0x70 <4> [233.851791] softirqs last disabled at (394800): [<ffffffff8133b344>] kernel_fpu_begin_mask+0xc4/0x120 <4> [233.851793] ---[ end trace 0000000000000000 ]--- <6> [233.851795] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.851866] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.851872] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.852126] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.852332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.852422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.852517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.852605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.852691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.852792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.852878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.852965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.853046] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.853140] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.853256] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.854265] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.864979] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.865229] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.866234] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.866306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.866376] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.866446] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.866516] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.866587] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.866656] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.866729] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.866802] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.866876] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.866949] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.867026] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.867104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.867179] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.867254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.867328] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.867402] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.867475] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.867549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.867630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.867709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.867802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.867882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.867959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.868037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.868117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.868195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.868275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.868355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.868433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.868510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.868587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.868670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.868764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.868851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.868933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.869013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.869091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.869168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.869244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.869323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.869400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.869478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.869556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.869638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.869715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.869806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.869882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.869959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.870033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.870107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.870186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.870262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.870337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.870412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.870488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.870562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.870636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.870715] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.870844] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.870849] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56700, lrc_seqno=56700, guc_id=0, flags=0x73 in no process [-1] <7> [233.870851] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.870910] ------------[ cut here ]------------ <4> [233.870911] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.870912] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:47/3221 <4> [233.870984] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.871048] efi_pstore nfnetlink autofs4 <4> [233.871052] CPU: 5 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.871055] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.871056] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.871058] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.871063] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.871132] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.871134] RSP: 0018:ffffc90007163ca0 EFLAGS: 00010246 <4> [233.871136] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.871137] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.871139] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.871140] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.871141] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.871143] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000 <4> [233.871144] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.871145] CR2: 0000738bc1c03c98 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [233.871147] PKRU: 55555554 <4> [233.871148] Call Trace: <4> [233.871149] <TASK> <4> [233.871153] ? lock_sync+0x100/0x100 <4> [233.871158] ? lock_release+0xd0/0x2b0 <4> [233.871163] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.871169] process_one_work+0x239/0x760 <4> [233.871175] worker_thread+0x200/0x3f0 <4> [233.871177] ? __pfx_worker_thread+0x10/0x10 <4> [233.871180] kthread+0x10d/0x150 <4> [233.871183] ? __pfx_kthread+0x10/0x10 <4> [233.871186] ret_from_fork+0x3d4/0x480 <4> [233.871188] ? __pfx_kthread+0x10/0x10 <4> [233.871192] ret_from_fork_asm+0x1a/0x30 <4> [233.871199] </TASK> <4> [233.871200] irq event stamp: 475431 <4> [233.871201] hardirqs last enabled at (475437): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.871204] hardirqs last disabled at (475442): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.871206] softirqs last enabled at (474406): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.871209] softirqs last disabled at (474399): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.871211] ---[ end trace 0000000000000000 ]--- <6> [233.871213] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.871283] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.871289] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.872522] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.872627] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.872738] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.872942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.873031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.873124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.873214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.873305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.873393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.873481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.873568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.873650] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.873756] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.873874] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.874882] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.885605] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.885848] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.886860] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.886934] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.887002] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.887074] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.887143] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.887215] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.887284] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.887354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.887422] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.887490] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.887557] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.887625] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.887692] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.887772] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.887848] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.887924] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.887999] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.888073] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.888149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.888232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.888314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.888393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.888472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.888548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.888623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.888699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.888785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.888865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.888949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.889030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.889110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.889189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.889274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.889362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.889449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.889531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.889611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.889688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.889776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.889854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.889935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.890014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.890092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.890167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.890247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.890324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.890401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.890476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.890553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.890627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.890701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.890792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.890870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.890951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.891030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.891109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.891185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.891261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.891340] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.891455] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.891459] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56700, lrc_seqno=56700, guc_id=0, flags=0x73 in no process [-1] <7> [233.891462] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.891521] ------------[ cut here ]------------ <4> [233.891522] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.891523] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:42/3216 <4> [233.891596] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.891659] efi_pstore nfnetlink autofs4 <4> [233.891664] CPU: 7 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.891667] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.891668] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.891670] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.891675] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.891749] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.891751] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [233.891754] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.891755] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.891757] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.891758] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.891759] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.891761] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000 <4> [233.891762] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.891764] CR2: 0000738bc0802898 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [233.891765] PKRU: 55555554 <4> [233.891767] Call Trace: <4> [233.891768] <TASK> <4> [233.891772] ? lock_sync+0x100/0x100 <4> [233.891776] ? lock_release+0xd0/0x2b0 <4> [233.891782] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.891787] process_one_work+0x239/0x760 <4> [233.891794] worker_thread+0x200/0x3f0 <4> [233.891797] ? __pfx_worker_thread+0x10/0x10 <4> [233.891799] kthread+0x10d/0x150 <4> [233.891802] ? __pfx_kthread+0x10/0x10 <4> [233.891805] ret_from_fork+0x3d4/0x480 <4> [233.891808] ? __pfx_kthread+0x10/0x10 <4> [233.891811] ret_from_fork_asm+0x1a/0x30 <4> [233.891818] </TASK> <4> [233.891819] irq event stamp: 1325769 <4> [233.891821] hardirqs last enabled at (1325775): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.891824] hardirqs last disabled at (1325780): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.891826] softirqs last enabled at (1324790): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.891828] softirqs last disabled at (1324783): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.891831] ---[ end trace 0000000000000000 ]--- <7> [233.892846] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.892951] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [233.893323] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56755, lrc_seqno=56755, guc_id=0, flags=0x73 in no process [-1] <7> [233.893326] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.893385] ------------[ cut here ]------------ <4> [233.893386] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.893387] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:48/3222 <4> [233.893458] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.893535] efi_pstore nfnetlink autofs4 <4> [233.893540] CPU: 6 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.893543] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.893544] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.893546] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.893551] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.893621] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.893623] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [233.893625] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.893627] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.893628] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.893630] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.893631] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.893633] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [233.893635] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.893636] CR2: 000070b5c344e008 CR3: 000000000344c006 CR4: 0000000000f72ef0 <4> [233.893638] PKRU: 55555554 <4> [233.893639] Call Trace: <4> [233.893640] <TASK> <4> [233.893644] ? lock_sync+0x100/0x100 <4> [233.893649] ? lock_release+0xd0/0x2b0 <4> [233.893655] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.893661] process_one_work+0x239/0x760 <4> [233.893667] worker_thread+0x200/0x3f0 <4> [233.893670] ? __pfx_worker_thread+0x10/0x10 <4> [233.893672] kthread+0x10d/0x150 <4> [233.893675] ? __pfx_kthread+0x10/0x10 <4> [233.893679] ret_from_fork+0x3d4/0x480 <4> [233.893681] ? __pfx_kthread+0x10/0x10 <4> [233.893684] ret_from_fork_asm+0x1a/0x30 <4> [233.893691] </TASK> <4> [233.893693] irq event stamp: 399923 <4> [233.893694] hardirqs last enabled at (399929): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.893696] hardirqs last disabled at (399934): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.893699] softirqs last enabled at (397986): [<ffffffff8133ac33>] kernel_fpu_end+0x53/0x70 <4> [233.893701] softirqs last disabled at (397984): [<ffffffff8133b344>] kernel_fpu_begin_mask+0xc4/0x120 <4> [233.893703] ---[ end trace 0000000000000000 ]--- <6> [233.893705] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.893795] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.893802] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.893959] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.894168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.894261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.894353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.894443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.894530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.894616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.894702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.894809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.894902] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.894998] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.895114] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.896127] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.906752] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.907002] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.907983] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.908062] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.908139] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.908215] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.908290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.908365] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.908440] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.908514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.908588] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.908661] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.908734] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.908826] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.908909] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.908983] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.909057] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.909132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.909204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.909280] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.909356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.909437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.909518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.909598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.909678] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.909764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.909853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.909928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.910003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.910081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.910158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.910235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.910313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.910395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.910480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.910565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.910650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.910734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.910835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.910926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.911005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.911082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.911161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.911238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.911316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.911392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.911473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.911547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.911623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.911698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.911792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.911882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.911959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.912039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.912116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.912193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.912268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.912345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.912420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.912495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.912575] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.912687] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.912692] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56755, lrc_seqno=56755, guc_id=0, flags=0x73 in no process [-1] <7> [233.912694] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.912822] ------------[ cut here ]------------ <4> [233.912827] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.912830] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:42/3216 <4> [233.913034] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.913105] efi_pstore nfnetlink autofs4 <4> [233.913111] CPU: 10 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.913116] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.913118] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.913120] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.913128] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.913233] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.913235] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [233.913237] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.913239] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.913241] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.913242] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.913243] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.913244] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [233.913246] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.913247] CR2: 000070b5c3455008 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [233.913250] PKRU: 55555554 <4> [233.913251] Call Trace: <4> [233.913253] <TASK> <4> [233.913258] ? lock_sync+0x100/0x100 <4> [233.913263] ? lock_release+0xd0/0x2b0 <4> [233.913269] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.913275] process_one_work+0x239/0x760 <4> [233.913282] worker_thread+0x200/0x3f0 <4> [233.913285] ? __pfx_worker_thread+0x10/0x10 <4> [233.913287] kthread+0x10d/0x150 <4> [233.913291] ? __pfx_kthread+0x10/0x10 <4> [233.913294] ret_from_fork+0x3d4/0x480 <4> [233.913297] ? __pfx_kthread+0x10/0x10 <4> [233.913300] ret_from_fork_asm+0x1a/0x30 <4> [233.913309] </TASK> <4> [233.913312] irq event stamp: 1331073 <4> [233.913313] hardirqs last enabled at (1331079): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.913316] hardirqs last disabled at (1331084): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.913318] softirqs last enabled at (1329972): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.913322] softirqs last disabled at (1329965): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.913325] ---[ end trace 0000000000000000 ]--- <6> [233.913328] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.913410] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.913423] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.913697] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.913840] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.913993] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.914216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.914314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.914411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.914504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.914595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.914685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.914780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.914873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.914960] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.915060] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.915183] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.916197] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.926979] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.927251] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.928269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.928356] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.928438] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.928521] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.928602] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.928684] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.928768] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.928848] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.928927] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.929008] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.929090] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.929172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.929251] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.929330] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.929408] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.929486] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.929564] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.929642] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.929722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.929819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.929906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.929991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.930075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.930156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.930237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.930320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.930403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.930488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.930573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.930655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.930738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.930828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.930916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.931005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.931096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.931185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.931270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.931353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.931434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.931515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.931600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.931684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.931771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.931854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.931941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.932024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.932107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.932186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.932266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.932346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.932428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.932514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.932597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.932679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.932767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.932853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.932934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.933014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.933098] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.933215] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.933220] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56755, lrc_seqno=56755, guc_id=0, flags=0x73 in no process [-1] <7> [233.933223] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.933286] ------------[ cut here ]------------ <4> [233.933287] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.933289] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:42/3216 <4> [233.933364] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.933428] efi_pstore nfnetlink autofs4 <4> [233.933433] CPU: 10 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.933436] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.933437] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.933439] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.933444] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.933519] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.933520] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [233.933523] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.933524] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.933526] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.933527] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.933528] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.933530] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [233.933531] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.933533] CR2: 000070b5c3455008 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [233.933534] PKRU: 55555554 <4> [233.933535] Call Trace: <4> [233.933536] <TASK> <4> [233.933540] ? lock_sync+0x100/0x100 <4> [233.933545] ? lock_release+0xd0/0x2b0 <4> [233.933550] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.933556] process_one_work+0x239/0x760 <4> [233.933563] worker_thread+0x200/0x3f0 <4> [233.933565] ? __pfx_worker_thread+0x10/0x10 <4> [233.933568] kthread+0x10d/0x150 <4> [233.933571] ? __pfx_kthread+0x10/0x10 <4> [233.933575] ret_from_fork+0x3d4/0x480 <4> [233.933577] ? __pfx_kthread+0x10/0x10 <4> [233.933580] ret_from_fork_asm+0x1a/0x30 <4> [233.933587] </TASK> <4> [233.933588] irq event stamp: 1334161 <4> [233.933590] hardirqs last enabled at (1334167): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.933593] hardirqs last disabled at (1334172): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.933595] softirqs last enabled at (1333038): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.933597] softirqs last disabled at (1333033): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.933600] ---[ end trace 0000000000000000 ]--- <5> [233.934283] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56810, lrc_seqno=56810, guc_id=0, flags=0x73 in no process [-1] <7> [233.934290] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.934392] ------------[ cut here ]------------ <4> [233.934394] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.934396] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:48/3222 <4> [233.934472] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.934540] efi_pstore nfnetlink autofs4 <4> [233.934545] CPU: 0 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.934549] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.934550] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.934553] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.934561] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.934638] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.934640] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [233.934642] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.934644] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.934645] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.934646] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.934648] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.934649] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [233.934651] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.934652] CR2: 0000738bc2804ff8 CR3: 0000000130336006 CR4: 0000000000f72ef0 <4> [233.934654] PKRU: 55555554 <4> [233.934656] Call Trace: <4> [233.934657] <TASK> <4> [233.934662] ? lock_sync+0x100/0x100 <4> [233.934668] ? lock_release+0xd0/0x2b0 <4> [233.934673] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.934681] process_one_work+0x239/0x760 <4> [233.934691] worker_thread+0x200/0x3f0 <4> [233.934694] ? __pfx_worker_thread+0x10/0x10 <4> [233.934696] kthread+0x10d/0x150 <4> [233.934699] ? __pfx_kthread+0x10/0x10 <4> [233.934703] ret_from_fork+0x3d4/0x480 <4> [233.934706] ? __pfx_kthread+0x10/0x10 <4> [233.934709] ret_from_fork_asm+0x1a/0x30 <4> [233.934716] </TASK> <4> [233.934717] irq event stamp: 402837 <4> [233.934719] hardirqs last enabled at (402843): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.934722] hardirqs last disabled at (402848): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.934724] softirqs last enabled at (400478): [<ffffffff8133ac33>] kernel_fpu_end+0x53/0x70 <4> [233.934727] softirqs last disabled at (400476): [<ffffffff8133b344>] kernel_fpu_begin_mask+0xc4/0x120 <4> [233.934730] ---[ end trace 0000000000000000 ]--- <6> [233.934732] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.934840] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.934900] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.935162] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.935275] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.935387] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.935591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.935681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.935784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.935874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.935961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.936049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.936136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.936224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.936305] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.936400] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.936517] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.937535] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.947782] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.948035] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.949013] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.949092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.949168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.949247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.949325] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.949401] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.949476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.949550] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.949624] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.949697] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.949772] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.949872] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.949949] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.950025] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.950100] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.950174] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.950249] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.950326] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.950402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.950484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.950564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.950643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.950722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.950810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.950887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.950963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.951040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.951119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.951202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.951283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.951366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.951449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.951535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.951620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.951704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.951792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.951873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.951949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.952030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.952109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.952191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.952271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.952348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.952425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.952509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.952588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.952666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.952741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.952825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.952901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.952976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.953055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.953132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.953209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.953286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.953368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.953445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.953520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.953598] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.953710] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.953714] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56810, lrc_seqno=56810, guc_id=0, flags=0x73 in no process [-1] <7> [233.953717] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.953787] ------------[ cut here ]------------ <4> [233.953789] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.953791] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:48/3222 <4> [233.953862] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.953925] efi_pstore nfnetlink autofs4 <4> [233.953929] CPU: 0 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.953932] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.953933] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.953935] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.953940] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.954010] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.954011] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [233.954014] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.954015] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.954016] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.954017] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.954019] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.954020] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [233.954021] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.954023] CR2: 0000738bc2804ff8 CR3: 0000000130336006 CR4: 0000000000f72ef0 <4> [233.954024] PKRU: 55555554 <4> [233.954026] Call Trace: <4> [233.954027] <TASK> <4> [233.954030] ? lock_sync+0x100/0x100 <4> [233.954035] ? lock_release+0xd0/0x2b0 <4> [233.954040] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.954046] process_one_work+0x239/0x760 <4> [233.954052] worker_thread+0x200/0x3f0 <4> [233.954055] ? __pfx_worker_thread+0x10/0x10 <4> [233.954057] kthread+0x10d/0x150 <4> [233.954060] ? __pfx_kthread+0x10/0x10 <4> [233.954064] ret_from_fork+0x3d4/0x480 <4> [233.954066] ? __pfx_kthread+0x10/0x10 <4> [233.954069] ret_from_fork_asm+0x1a/0x30 <4> [233.954076] </TASK> <4> [233.954077] irq event stamp: 406085 <4> [233.954079] hardirqs last enabled at (406091): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.954081] hardirqs last disabled at (406096): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.954084] softirqs last enabled at (405328): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.954086] softirqs last disabled at (405305): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.954088] ---[ end trace 0000000000000000 ]--- <6> [233.954090] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.954160] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.954166] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.955460] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.955564] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [233.955668] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.955886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.955984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.956084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.956174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.956267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.956352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.956438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.956525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.956634] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.956734] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.956864] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.957888] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.968617] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.968870] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.969874] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.969953] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.970025] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.970096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.970166] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.970236] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.970303] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.970371] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.970439] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.970507] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.970575] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.970644] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.970714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.970784] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.970874] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.970948] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.971021] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.971095] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.971168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.971249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.971344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.971442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.971523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.971610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.971693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.971775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.971866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.971946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.972026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.972115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.972208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.972289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.972377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.972465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.972551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.972636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.972718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.972806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.972900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.972981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.973066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.973151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.973232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.973310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.973391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.973472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.973570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.973660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.973747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.973832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.973918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.974002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.974081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.974159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.974236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.974338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.974414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.974497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.974576] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.974694] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.974698] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56810, lrc_seqno=56810, guc_id=0, flags=0x73 in no process [-1] <7> [233.974701] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.974760] ------------[ cut here ]------------ <4> [233.974762] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.974763] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:47/3221 <4> [233.974847] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.974912] efi_pstore nfnetlink autofs4 <4> [233.974917] CPU: 5 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.974920] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.974922] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.974923] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.974928] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.974999] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.975001] RSP: 0018:ffffc90007163ca0 EFLAGS: 00010246 <4> [233.975003] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.975005] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.975006] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.975007] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.975008] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.975010] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000 <4> [233.975011] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.975013] CR2: 0000738bc1c03c98 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [233.975014] PKRU: 55555554 <4> [233.975015] Call Trace: <4> [233.975017] <TASK> <4> [233.975021] ? lock_sync+0x100/0x100 <4> [233.975025] ? lock_release+0xd0/0x2b0 <4> [233.975031] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.975037] process_one_work+0x239/0x760 <4> [233.975043] worker_thread+0x200/0x3f0 <4> [233.975046] ? __pfx_worker_thread+0x10/0x10 <4> [233.975048] kthread+0x10d/0x150 <4> [233.975051] ? __pfx_kthread+0x10/0x10 <4> [233.975055] ret_from_fork+0x3d4/0x480 <4> [233.975057] ? __pfx_kthread+0x10/0x10 <4> [233.975060] ret_from_fork_asm+0x1a/0x30 <4> [233.975071] </TASK> <4> [233.975073] irq event stamp: 480293 <4> [233.975075] hardirqs last enabled at (480299): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.975079] hardirqs last disabled at (480304): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.975083] softirqs last enabled at (479306): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.975087] softirqs last disabled at (479299): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.975091] ---[ end trace 0000000000000000 ]--- <5> [233.976525] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56865, lrc_seqno=56865, guc_id=0, flags=0x73 in no process [-1] <7> [233.976528] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.976589] ------------[ cut here ]------------ <4> [233.976591] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.976593] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:47/3221 <4> [233.976663] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.976736] efi_pstore nfnetlink autofs4 <4> [233.976741] CPU: 5 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.976744] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.976746] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.976747] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.976753] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.976832] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.976834] RSP: 0018:ffffc90007163ca0 EFLAGS: 00010246 <4> [233.976836] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.976838] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.976839] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.976841] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.976842] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.976843] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000 <4> [233.976845] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.976846] CR2: 0000738bc1c03c98 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [233.976848] PKRU: 55555554 <4> [233.976849] Call Trace: <4> [233.976850] <TASK> <4> [233.976854] ? lock_sync+0x100/0x100 <4> [233.976858] ? lock_release+0xd0/0x2b0 <4> [233.976864] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.976869] process_one_work+0x239/0x760 <4> [233.976875] worker_thread+0x200/0x3f0 <4> [233.976878] ? __pfx_worker_thread+0x10/0x10 <4> [233.976880] kthread+0x10d/0x150 <4> [233.976883] ? __pfx_kthread+0x10/0x10 <4> [233.976887] ret_from_fork+0x3d4/0x480 <4> [233.976889] ? __pfx_kthread+0x10/0x10 <4> [233.976892] ret_from_fork_asm+0x1a/0x30 <4> [233.976900] </TASK> <4> [233.976901] irq event stamp: 482849 <4> [233.976902] hardirqs last enabled at (482855): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.976905] hardirqs last disabled at (482860): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.976907] softirqs last enabled at (479306): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.976909] softirqs last disabled at (479299): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.976912] ---[ end trace 0000000000000000 ]--- <7> [233.976925] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [233.977049] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [233.977161] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.977240] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.977246] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.977464] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.977671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.977763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.977890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.977981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.978069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.978156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.978244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.978334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.978441] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.978563] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.978706] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.979751] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [233.989810] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [233.990061] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [233.991083] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [233.991161] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [233.991236] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [233.991311] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [233.991388] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [233.991466] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [233.991542] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [233.991617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [233.991692] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [233.991766] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [233.991856] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [233.991931] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [233.992005] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [233.992077] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [233.992150] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [233.992223] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [233.992295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [233.992368] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [233.992442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [233.992523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [233.992604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [233.992685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [233.992766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [233.992859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [233.992936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [233.993013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [233.993089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [233.993169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [233.993249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [233.993325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [233.993403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [233.993483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [233.993566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [233.993650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [233.993734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [233.993821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [233.993901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [233.993981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [233.994063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [233.994140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [233.994219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [233.994297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [233.994372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [233.994441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [233.994513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [233.994582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [233.994652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [233.994720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [233.994791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [233.994872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [233.994941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [233.995012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [233.995084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [233.995159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [233.995231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [233.995302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [233.995370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [233.995438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [233.995510] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [233.995615] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [233.995619] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56865, lrc_seqno=56865, guc_id=0, flags=0x73 in no process [-1] <7> [233.995622] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [233.995682] ------------[ cut here ]------------ <4> [233.995683] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [233.995684] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:48/3222 <4> [233.995750] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [233.995829] efi_pstore nfnetlink autofs4 <4> [233.995833] CPU: 0 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [233.995836] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [233.995838] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [233.995839] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [233.995844] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [233.995909] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [233.995911] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [233.995913] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [233.995915] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [233.995916] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [233.995917] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [233.995918] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [233.995919] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [233.995921] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [233.995922] CR2: 0000738bc2804ff8 CR3: 0000000130336006 CR4: 0000000000f72ef0 <4> [233.995923] PKRU: 55555554 <4> [233.995924] Call Trace: <4> [233.995925] <TASK> <4> [233.995929] ? lock_sync+0x100/0x100 <4> [233.995933] ? lock_release+0xd0/0x2b0 <4> [233.995938] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [233.995943] process_one_work+0x239/0x760 <4> [233.995949] worker_thread+0x200/0x3f0 <4> [233.995951] ? __pfx_worker_thread+0x10/0x10 <4> [233.995953] kthread+0x10d/0x150 <4> [233.995956] ? __pfx_kthread+0x10/0x10 <4> [233.995959] ret_from_fork+0x3d4/0x480 <4> [233.995961] ? __pfx_kthread+0x10/0x10 <4> [233.995964] ret_from_fork_asm+0x1a/0x30 <4> [233.995971] </TASK> <4> [233.995972] irq event stamp: 411957 <4> [233.995973] hardirqs last enabled at (411963): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [233.995976] hardirqs last disabled at (411968): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [233.995978] softirqs last enabled at (410954): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.995980] softirqs last disabled at (410947): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [233.995982] ---[ end trace 0000000000000000 ]--- <6> [233.995984] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [233.996048] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [233.996081] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [233.996485] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [233.996681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [233.996762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [233.996860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [233.996940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [233.997019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [233.997104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [233.997185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [233.997265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [233.997343] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [233.997432] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [233.997540] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [233.998554] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.008824] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.009070] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.010173] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.010252] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.010328] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.010404] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.010479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.010554] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.010628] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.010703] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.010776] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.010861] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.010935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.011008] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.011082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.011156] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.011231] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.011304] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.011378] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.011452] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.011526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.011607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.011687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.011766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.011857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.011935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.012010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.012085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.012160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.012238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.012317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.012395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.012473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.012550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.012636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.012723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.012808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.012906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.012987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.013064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.013140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.013215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.013292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.013370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.013446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.013520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.013598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.013676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.013751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.013832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.013911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.013985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.014060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.014137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.014213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.014289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.014369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.014449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.014526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.014602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.014682] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.014793] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.014797] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56865, lrc_seqno=56865, guc_id=0, flags=0x73 in no process [-1] <7> [234.014800] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.015718] ------------[ cut here ]------------ <4> [234.015719] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.015721] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:48/3222 <4> [234.015799] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [234.015875] efi_pstore nfnetlink autofs4 <4> [234.015880] CPU: 0 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [234.015883] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.015885] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.015886] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.015892] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.015961] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.015963] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [234.015965] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.015967] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [234.015969] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.015970] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.015971] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [234.015973] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [234.015975] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.015976] CR2: 0000738bc2804ff8 CR3: 0000000130336006 CR4: 0000000000f72ef0 <4> [234.015978] PKRU: 55555554 <4> [234.015979] Call Trace: <4> [234.015981] <TASK> <4> [234.015985] ? lock_sync+0x100/0x100 <4> [234.015989] ? lock_release+0xd0/0x2b0 <4> [234.015995] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.016000] process_one_work+0x239/0x760 <4> [234.016007] worker_thread+0x200/0x3f0 <4> [234.016009] ? __pfx_worker_thread+0x10/0x10 <4> [234.016012] kthread+0x10d/0x150 <4> [234.016015] ? __pfx_kthread+0x10/0x10 <4> [234.016019] ret_from_fork+0x3d4/0x480 <4> [234.016021] ? __pfx_kthread+0x10/0x10 <4> [234.016025] ret_from_fork_asm+0x1a/0x30 <4> [234.016032] </TASK> <4> [234.016034] irq event stamp: 415247 <4> [234.016035] hardirqs last enabled at (415253): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [234.016038] hardirqs last disabled at (415258): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [234.016040] softirqs last enabled at (414686): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.016043] softirqs last disabled at (414675): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.016045] ---[ end trace 0000000000000000 ]--- <7> [234.016058] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.016161] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [234.016861] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56920, lrc_seqno=56920, guc_id=0, flags=0x73 in no process [-1] <7> [234.016864] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.016924] ------------[ cut here ]------------ <4> [234.016925] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.016926] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:48/3222 <4> [234.016998] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [234.017059] efi_pstore nfnetlink autofs4 <4> [234.017063] CPU: 0 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [234.017066] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.017067] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.017069] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.017073] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.017143] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.017145] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [234.017147] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.017148] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [234.017149] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.017151] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.017152] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [234.017153] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [234.017155] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.017156] CR2: 0000738bc2804ff8 CR3: 0000000130336006 CR4: 0000000000f72ef0 <4> [234.017157] PKRU: 55555554 <4> [234.017158] Call Trace: <4> [234.017160] <TASK> <4> [234.017163] ? lock_sync+0x100/0x100 <4> [234.017167] ? lock_release+0xd0/0x2b0 <4> [234.017173] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.017178] process_one_work+0x239/0x760 <4> [234.017184] worker_thread+0x200/0x3f0 <4> [234.017187] ? __pfx_worker_thread+0x10/0x10 <4> [234.017189] kthread+0x10d/0x150 <4> [234.017192] ? __pfx_kthread+0x10/0x10 <4> [234.017195] ret_from_fork+0x3d4/0x480 <4> [234.017197] ? __pfx_kthread+0x10/0x10 <4> [234.017201] ret_from_fork_asm+0x1a/0x30 <4> [234.017208] </TASK> <4> [234.017209] irq event stamp: 417987 <4> [234.017210] hardirqs last enabled at (417993): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [234.017213] hardirqs last disabled at (417998): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [234.017215] softirqs last enabled at (417114): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.017217] softirqs last disabled at (417107): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.017220] ---[ end trace 0000000000000000 ]--- <6> [234.017221] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.017292] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.017299] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.017423] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.017629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.017721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.017832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.017932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.018026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.018109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.018198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.018287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.018374] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.018472] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.018609] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.019644] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.029841] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.030094] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.031111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.031213] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.031314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.031400] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.031477] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.031557] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.031632] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.031707] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.031782] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.031866] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.031953] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.032040] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.032119] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.032199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.032281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.032357] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.032431] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.032506] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.032579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.032659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.032764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.032850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.032939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.033018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.033101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.033178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.033254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.033333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.033415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.033516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.033601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.033687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.033778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.033868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.033953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.034033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.034112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.034213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.034290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.034372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.034450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.034535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.034615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.034694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.034775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.034857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.034949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.035043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.035125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.035208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.035289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.035374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.035452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.035529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.035604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.035694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.035782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.035877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.035960] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.036076] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.036080] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56920, lrc_seqno=56920, guc_id=0, flags=0x73 in no process [-1] <7> [234.036083] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.036141] ------------[ cut here ]------------ <4> [234.036143] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.036144] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:47/3221 <4> [234.036216] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [234.036280] efi_pstore nfnetlink autofs4 <4> [234.036285] CPU: 5 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [234.036288] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.036289] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.036291] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.036296] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.036367] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.036368] RSP: 0018:ffffc90007163ca0 EFLAGS: 00010246 <4> [234.036371] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.036372] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [234.036374] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.036375] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.036376] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [234.036377] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000 <4> [234.036379] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.036380] CR2: 0000738bc1c03c98 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [234.036382] PKRU: 55555554 <4> [234.036383] Call Trace: <4> [234.036384] <TASK> <4> [234.036388] ? lock_sync+0x100/0x100 <4> [234.036393] ? lock_release+0xd0/0x2b0 <4> [234.036398] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.036404] process_one_work+0x239/0x760 <4> [234.036410] worker_thread+0x200/0x3f0 <4> [234.036412] ? __pfx_worker_thread+0x10/0x10 <4> [234.036415] kthread+0x10d/0x150 <4> [234.036418] ? __pfx_kthread+0x10/0x10 <4> [234.036421] ret_from_fork+0x3d4/0x480 <4> [234.036423] ? __pfx_kthread+0x10/0x10 <4> [234.036427] ret_from_fork_asm+0x1a/0x30 <4> [234.036436] </TASK> <4> [234.036438] irq event stamp: 488489 <4> [234.036440] hardirqs last enabled at (488495): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [234.036445] hardirqs last disabled at (488500): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [234.036448] softirqs last enabled at (487640): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.036452] softirqs last disabled at (487633): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.036456] ---[ end trace 0000000000000000 ]--- <6> [234.036459] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.036553] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.036559] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.037795] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.037912] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [234.038042] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.038247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.038337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.038430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.038519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.038608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.038697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.038785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.038884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.038968] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.039062] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.039178] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.040219] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.050855] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.051104] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.052067] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.052147] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.052224] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.052301] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.052378] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.052453] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.052528] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.052602] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.052675] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.052750] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.052828] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.052917] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.052994] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.053069] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.053143] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.053216] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.053291] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.053365] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.053439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.053521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.053602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.053680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.053763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.053843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.053938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.054016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.054092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.054170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.054249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.054327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.054411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.054493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.054578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.054663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.054746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.054827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.054913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.054990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.055069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.055149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.055231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.055309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.055387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.055463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.055543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.055618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.055695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.055774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.055861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.055942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.056019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.056099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.056176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.056250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.056319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.056393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.056464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.056534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.056606] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.056710] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.056714] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56920, lrc_seqno=56920, guc_id=0, flags=0x73 in no process [-1] <7> [234.056717] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.056776] ------------[ cut here ]------------ <4> [234.056777] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.056778] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:48/3222 <4> [234.056842] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [234.056904] efi_pstore nfnetlink autofs4 <4> [234.056908] CPU: 0 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [234.056911] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.056912] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.056913] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.056918] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.056981] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.056982] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [234.056985] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.056986] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [234.056987] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.056988] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.056989] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [234.056990] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [234.056992] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.056993] CR2: 0000738bc2804ff8 CR3: 0000000130336006 CR4: 0000000000f72ef0 <4> [234.056994] PKRU: 55555554 <4> [234.056995] Call Trace: <4> [234.056996] <TASK> <4> [234.057000] ? lock_sync+0x100/0x100 <4> [234.057004] ? lock_release+0xd0/0x2b0 <4> [234.057009] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.057014] process_one_work+0x239/0x760 <4> [234.057020] worker_thread+0x200/0x3f0 <4> [234.057022] ? __pfx_worker_thread+0x10/0x10 <4> [234.057025] kthread+0x10d/0x150 <4> [234.057027] ? __pfx_kthread+0x10/0x10 <4> [234.057030] ret_from_fork+0x3d4/0x480 <4> [234.057032] ? __pfx_kthread+0x10/0x10 <4> [234.057035] ret_from_fork_asm+0x1a/0x30 <4> [234.057042] </TASK> <4> [234.057043] irq event stamp: 421791 <4> [234.057044] hardirqs last enabled at (421797): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [234.057046] hardirqs last disabled at (421802): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [234.057049] softirqs last enabled at (420794): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.057051] softirqs last disabled at (420787): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.057053] ---[ end trace 0000000000000000 ]--- <5> [234.057643] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56975, lrc_seqno=56975, guc_id=0, flags=0x73 in no process [-1] <7> [234.057649] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.057794] ------------[ cut here ]------------ <4> [234.057797] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.057800] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:42/3216 <4> [234.057901] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [234.057975] efi_pstore nfnetlink autofs4 <4> [234.057982] CPU: 10 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [234.057985] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.057986] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.057989] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.057996] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.058082] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.058083] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [234.058086] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.058087] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [234.058089] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.058090] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.058091] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [234.058092] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [234.058094] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.058096] CR2: 000070b5c3455008 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [234.058097] PKRU: 55555554 <4> [234.058098] Call Trace: <4> [234.058100] <TASK> <4> [234.058104] ? lock_sync+0x100/0x100 <4> [234.058109] ? lock_release+0xd0/0x2b0 <4> [234.058115] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.058120] process_one_work+0x239/0x760 <4> [234.058128] worker_thread+0x200/0x3f0 <4> [234.058130] ? __pfx_worker_thread+0x10/0x10 <4> [234.058133] kthread+0x10d/0x150 <4> [234.058136] ? __pfx_kthread+0x10/0x10 <4> [234.058139] ret_from_fork+0x3d4/0x480 <4> [234.058142] ? __pfx_kthread+0x10/0x10 <4> [234.058146] ret_from_fork_asm+0x1a/0x30 <4> [234.058154] </TASK> <4> [234.058155] irq event stamp: 1339397 <4> [234.058156] hardirqs last enabled at (1339403): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [234.058159] hardirqs last disabled at (1339408): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [234.058162] softirqs last enabled at (1338654): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.058164] softirqs last disabled at (1338649): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.058167] ---[ end trace 0000000000000000 ]--- <6> [234.058169] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.058253] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.058324] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.058553] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.058656] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [234.058760] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.058968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.059063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.059161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.059256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.059348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.059438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.059530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.059624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.059713] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.059814] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.059946] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.060972] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.070874] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.071141] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.072195] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.072282] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.072363] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.072445] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.072526] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.072606] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.072687] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.072768] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.072850] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.072944] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.073024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.073103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.073181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.073259] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.073336] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.073413] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.073490] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.073568] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.073645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.073731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.073819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.073914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.074001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.074084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.074166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.074247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.074326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.074408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.074491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.074574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.074658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.074741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.074830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.074927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.075015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.075103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.075191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.075275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.075358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.075440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.075524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.075607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.075689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.075770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.075855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.075948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.076030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.076110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.076192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.076273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.076357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.076443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.076526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.076610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.076692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.076773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.076852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.076942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.077025] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.077141] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.077146] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56975, lrc_seqno=56975, guc_id=0, flags=0x73 in no process [-1] <7> [234.077148] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.077210] ------------[ cut here ]------------ <4> [234.077212] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.077213] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:42/3216 <4> [234.077288] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [234.077360] efi_pstore nfnetlink autofs4 <4> [234.077365] CPU: 10 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [234.077368] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.077369] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.077371] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.077377] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.077451] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.077453] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [234.077455] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.077456] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [234.077458] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.077459] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.077460] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [234.077461] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000 <4> [234.077463] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.077464] CR2: 000070b5c3455008 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [234.077466] PKRU: 55555554 <4> [234.077467] Call Trace: <4> [234.077468] <TASK> <4> [234.077472] ? lock_sync+0x100/0x100 <4> [234.077477] ? lock_release+0xd0/0x2b0 <4> [234.077483] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.077489] process_one_work+0x239/0x760 <4> [234.077495] worker_thread+0x200/0x3f0 <4> [234.077498] ? __pfx_worker_thread+0x10/0x10 <4> [234.077500] kthread+0x10d/0x150 <4> [234.077503] ? __pfx_kthread+0x10/0x10 <4> [234.077507] ret_from_fork+0x3d4/0x480 <4> [234.077509] ? __pfx_kthread+0x10/0x10 <4> [234.077513] ret_from_fork_asm+0x1a/0x30 <4> [234.077520] </TASK> <4> [234.077521] irq event stamp: 1342591 <4> [234.077522] hardirqs last enabled at (1342597): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [234.077525] hardirqs last disabled at (1342602): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [234.077527] softirqs last enabled at (1341568): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.077530] softirqs last disabled at (1341563): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.077532] ---[ end trace 0000000000000000 ]--- <6> [234.077534] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.077609] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.077615] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.078773] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.078884] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [234.078989] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.079195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.079285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.079381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.079470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.079557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.079641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.079725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.079810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.079898] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.079992] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.080109] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.081118] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.090892] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.091141] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.092157] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.092236] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.092313] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.092392] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.092469] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.092545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.092620] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.092694] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.092768] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.092843] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.092935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.093009] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.093081] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.093156] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.093234] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.093309] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.093383] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.093456] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.093530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.093611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.093690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.093767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.093849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.093939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.094017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.094095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.094170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.094250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.094328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.094407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.094489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.094571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.094656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.094742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.094827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.094917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.094997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.095074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.095151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.095227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.095306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.095383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.095460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.095536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.095617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.095692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.095773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.095853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.095946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.096022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.096098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.096177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.096253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.096330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.096404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.096480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.096556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.096634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.096714] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.096825] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.096830] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=56975, lrc_seqno=56975, guc_id=0, flags=0x73 in no process [-1] <7> [234.096832] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.096905] ------------[ cut here ]------------ <4> [234.096907] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.096909] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:48/3222 <4> [234.096979] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [234.097044] efi_pstore nfnetlink autofs4 <4> [234.097048] CPU: 0 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [234.097051] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.097052] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.097054] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.097059] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.097128] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.097129] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [234.097132] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.097133] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [234.097134] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.097135] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.097137] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [234.097138] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [234.097140] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.097141] CR2: 0000738bc2804ff8 CR3: 0000000130336006 CR4: 0000000000f72ef0 <4> [234.097142] PKRU: 55555554 <4> [234.097144] Call Trace: <4> [234.097145] <TASK> <4> [234.097149] ? lock_sync+0x100/0x100 <4> [234.097153] ? lock_release+0xd0/0x2b0 <4> [234.097158] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.097164] process_one_work+0x239/0x760 <4> [234.097170] worker_thread+0x200/0x3f0 <4> [234.097173] ? __pfx_worker_thread+0x10/0x10 <4> [234.097175] kthread+0x10d/0x150 <4> [234.097178] ? __pfx_kthread+0x10/0x10 <4> [234.097182] ret_from_fork+0x3d4/0x480 <4> [234.097184] ? __pfx_kthread+0x10/0x10 <4> [234.097187] ret_from_fork_asm+0x1a/0x30 <4> [234.097194] </TASK> <4> [234.097195] irq event stamp: 427701 <4> [234.097197] hardirqs last enabled at (427707): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [234.097199] hardirqs last disabled at (427712): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [234.097202] softirqs last enabled at (426940): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.097204] softirqs last disabled at (426917): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.097206] ---[ end trace 0000000000000000 ]--- <5> [234.098594] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=57030, lrc_seqno=57030, guc_id=0, flags=0x73 in no process [-1] <7> [234.098597] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.098665] ------------[ cut here ]------------ <4> [234.098667] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.098668] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:48/3222 <4> [234.098738] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [234.098799] efi_pstore nfnetlink autofs4 <4> [234.098803] CPU: 0 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [234.098806] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.098807] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.098808] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.098813] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.098887] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.098890] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [234.098894] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.098896] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [234.098898] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.098899] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.098901] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [234.098902] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [234.098904] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.098905] CR2: 0000738bc2804ff8 CR3: 0000000130336006 CR4: 0000000000f72ef0 <4> [234.098907] PKRU: 55555554 <4> [234.098908] Call Trace: <4> [234.098909] <TASK> <4> [234.098913] ? lock_sync+0x100/0x100 <4> [234.098918] ? lock_release+0xd0/0x2b0 <4> [234.098923] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.098929] process_one_work+0x239/0x760 <4> [234.098935] worker_thread+0x200/0x3f0 <4> [234.098938] ? __pfx_worker_thread+0x10/0x10 <4> [234.098941] kthread+0x10d/0x150 <4> [234.098944] ? __pfx_kthread+0x10/0x10 <4> [234.098948] ret_from_fork+0x3d4/0x480 <4> [234.098950] ? __pfx_kthread+0x10/0x10 <4> [234.098953] ret_from_fork_asm+0x1a/0x30 <4> [234.098961] </TASK> <4> [234.098962] irq event stamp: 430405 <4> [234.098963] hardirqs last enabled at (430411): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [234.098966] hardirqs last disabled at (430416): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [234.098969] softirqs last enabled at (430244): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.098971] softirqs last disabled at (430239): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.098974] ---[ end trace 0000000000000000 ]--- <7> [234.098986] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.099090] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [234.099188] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.099260] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.099266] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.099316] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.099527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.099619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.099722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.099819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.099912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.099999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.100084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.100170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.100252] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.100357] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.100496] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.101535] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.111900] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.112148] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.113154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.113241] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.113339] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.113422] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.113493] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.113565] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.113638] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.113707] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.113776] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.113843] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.113932] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.114019] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.114087] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.114159] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.114227] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.114301] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.114371] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.114440] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.114507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.114581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.114663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.114757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.114834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.114919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.114998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.115076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.115147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.115220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.115292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.115363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.115458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.115528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.115610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.115690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.115776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.115854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.115939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.116011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.116082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.116174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.116247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.116322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.116392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.116466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.116541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.116614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.116687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.116758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.116830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.116945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.117020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.117100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.117172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.117248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.117326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.117405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.117487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.117567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.117647] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.117759] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.117764] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=57030, lrc_seqno=57030, guc_id=0, flags=0x73 in no process [-1] <7> [234.117766] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.117825] ------------[ cut here ]------------ <4> [234.117826] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.117827] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:47/3221 <4> [234.117906] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [234.117969] efi_pstore nfnetlink autofs4 <4> [234.117973] CPU: 5 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [234.117976] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.117977] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.117979] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.117983] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.118048] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.118050] RSP: 0018:ffffc90007163ca0 EFLAGS: 00010246 <4> [234.118053] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.118054] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [234.118055] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.118057] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.118058] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [234.118059] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000 <4> [234.118061] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.118062] CR2: 0000738bc1c03c98 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [234.118064] PKRU: 55555554 <4> [234.118065] Call Trace: <4> [234.118066] <TASK> <4> [234.118070] ? lock_sync+0x100/0x100 <4> [234.118074] ? lock_release+0xd0/0x2b0 <4> [234.118080] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.118086] process_one_work+0x239/0x760 <4> [234.118092] worker_thread+0x200/0x3f0 <4> [234.118094] ? __pfx_worker_thread+0x10/0x10 <4> [234.118097] kthread+0x10d/0x150 <4> [234.118100] ? __pfx_kthread+0x10/0x10 <4> [234.118103] ret_from_fork+0x3d4/0x480 <4> [234.118105] ? __pfx_kthread+0x10/0x10 <4> [234.118109] ret_from_fork_asm+0x1a/0x30 <4> [234.118116] </TASK> <4> [234.118117] irq event stamp: 494727 <4> [234.118118] hardirqs last enabled at (494733): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [234.118121] hardirqs last disabled at (494738): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [234.118123] softirqs last enabled at (493824): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.118126] softirqs last disabled at (493769): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.118128] ---[ end trace 0000000000000000 ]--- <6> [234.118131] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.118202] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.118209] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.118612] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.118813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.118907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.118997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.119077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.119166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.119252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.119339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.119427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.119509] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.119603] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.119718] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.120726] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.131257] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.131500] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.132653] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.132734] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.132810] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.132888] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.132976] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.133050] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.133124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.133198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.133272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.133346] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.133420] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.133493] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.133567] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.133644] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.133720] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.133794] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.133868] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.133950] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.134024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.134106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.134187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.134265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.134347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.134424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.134502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.134577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.134654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.134732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.134811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.134888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.134975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.135052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.135139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.135225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.135310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.135391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.135470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.135548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.135624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.135704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.135787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.135866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.135952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.136029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.136111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.136192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.136271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.136348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.136428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.136504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.136580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.136662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.136741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.136819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.136896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.136985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.137061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.137137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.137215] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.137326] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.137330] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=57030, lrc_seqno=57030, guc_id=0, flags=0x73 in no process [-1] <7> [234.137333] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.137390] ------------[ cut here ]------------ <4> [234.137392] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.137393] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:47/3221 <4> [234.137463] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [234.137526] efi_pstore nfnetlink autofs4 <4> [234.137531] CPU: 5 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [234.137533] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.137534] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.137536] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.137541] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.137610] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.137612] RSP: 0018:ffffc90007163ca0 EFLAGS: 00010246 <4> [234.137614] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.137615] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [234.137617] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.137618] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.137619] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [234.137621] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000 <4> [234.137622] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.137624] CR2: 0000738bc1c03c98 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [234.137625] PKRU: 55555554 <4> [234.137626] Call Trace: <4> [234.137627] <TASK> <4> [234.137631] ? lock_sync+0x100/0x100 <4> [234.137636] ? lock_release+0xd0/0x2b0 <4> [234.137641] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.137647] process_one_work+0x239/0x760 <4> [234.137653] worker_thread+0x200/0x3f0 <4> [234.137655] ? __pfx_worker_thread+0x10/0x10 <4> [234.137658] kthread+0x10d/0x150 <4> [234.137661] ? __pfx_kthread+0x10/0x10 <4> [234.137664] ret_from_fork+0x3d4/0x480 <4> [234.137666] ? __pfx_kthread+0x10/0x10 <4> [234.137670] ret_from_fork_asm+0x1a/0x30 <4> [234.137677] </TASK> <4> [234.137678] irq event stamp: 497823 <4> [234.137679] hardirqs last enabled at (497829): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [234.137682] hardirqs last disabled at (497834): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [234.137684] softirqs last enabled at (496874): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.137686] softirqs last disabled at (496865): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.137689] ---[ end trace 0000000000000000 ]--- <5> [234.138915] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=57085, lrc_seqno=57085, guc_id=0, flags=0x73 in no process [-1] <7> [234.138918] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.138979] ------------[ cut here ]------------ <4> [234.138980] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.138981] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:47/3221 <4> [234.139051] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [234.139112] efi_pstore nfnetlink autofs4 <4> [234.139117] CPU: 5 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [234.139119] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.139120] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.139121] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.139126] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.139196] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.139198] RSP: 0018:ffffc90007163ca0 EFLAGS: 00010246 <4> [234.139200] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.139202] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [234.139203] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.139205] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.139206] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [234.139207] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000 <4> [234.139209] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.139211] CR2: 0000738bc1c03c98 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [234.139212] PKRU: 55555554 <4> [234.139214] Call Trace: <4> [234.139215] <TASK> <4> [234.139219] ? lock_sync+0x100/0x100 <4> [234.139223] ? lock_release+0xd0/0x2b0 <4> [234.139229] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.139234] process_one_work+0x239/0x760 <4> [234.139240] worker_thread+0x200/0x3f0 <4> [234.139243] ? __pfx_worker_thread+0x10/0x10 <4> [234.139246] kthread+0x10d/0x150 <4> [234.139249] ? __pfx_kthread+0x10/0x10 <4> [234.139253] ret_from_fork+0x3d4/0x480 <4> [234.139255] ? __pfx_kthread+0x10/0x10 <4> [234.139258] ret_from_fork_asm+0x1a/0x30 <4> [234.139266] </TASK> <4> [234.139267] irq event stamp: 499193 <4> [234.139268] hardirqs last enabled at (499199): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [234.139271] hardirqs last disabled at (499204): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [234.139273] softirqs last enabled at (498408): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.139276] softirqs last disabled at (498403): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.139278] ---[ end trace 0000000000000000 ]--- <6> [234.139280] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.139350] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.139357] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.139369] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.139472] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [234.139591] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.139801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.139893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.140005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.140099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.140188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.140272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.140356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.140441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.140522] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.140615] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.140732] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.141741] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.151930] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.152180] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.153191] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.153271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.153346] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.153423] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.153498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.153574] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.153649] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.153724] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.153798] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.153872] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.153959] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.154034] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.154108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.154183] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.154256] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.154329] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.154403] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.154478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.154555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.154637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.154719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.154798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.154877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.155098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.155176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.155253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.155331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.155414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.155498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.155578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.155658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.155737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.155822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.155904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.156004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.156085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.156167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.156247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.156328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.156405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.156485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.156563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.156640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.156716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.156796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.156871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.156957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.157033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.157109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.157183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.157258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.157338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.157417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.157496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.157572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.157649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.157727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.157807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.157889] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.158018] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.158022] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=57085, lrc_seqno=57085, guc_id=0, flags=0x73 in no process [-1] <7> [234.158025] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.158084] ------------[ cut here ]------------ <4> [234.158086] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.158087] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:48/3222 <4> [234.158159] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [234.158224] efi_pstore nfnetlink autofs4 <4> [234.158229] CPU: 0 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [234.158232] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.158233] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.158235] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.158240] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.158310] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.158312] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [234.158315] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.158316] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [234.158317] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.158318] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.158320] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [234.158321] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [234.158323] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.158324] CR2: 0000738bc2804ff8 CR3: 000000000344c005 CR4: 0000000000f72ef0 <4> [234.158326] PKRU: 55555554 <4> [234.158327] Call Trace: <4> [234.158328] <TASK> <4> [234.158332] ? lock_sync+0x100/0x100 <4> [234.158336] ? lock_release+0xd0/0x2b0 <4> [234.158342] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.158348] process_one_work+0x239/0x760 <4> [234.158354] worker_thread+0x200/0x3f0 <4> [234.158357] ? __pfx_worker_thread+0x10/0x10 <4> [234.158359] kthread+0x10d/0x150 <4> [234.158362] ? __pfx_kthread+0x10/0x10 <4> [234.158365] ret_from_fork+0x3d4/0x480 <4> [234.158367] ? __pfx_kthread+0x10/0x10 <4> [234.158371] ret_from_fork_asm+0x1a/0x30 <4> [234.158378] </TASK> <4> [234.158379] irq event stamp: 436095 <4> [234.158380] hardirqs last enabled at (436101): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [234.158383] hardirqs last disabled at (436106): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [234.158385] softirqs last enabled at (435260): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.158388] softirqs last disabled at (435243): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.158390] ---[ end trace 0000000000000000 ]--- <6> [234.158392] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.158462] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.158468] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.159703] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.159808] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [234.159916] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.160149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.160248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.160348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.160445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.160542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.160636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.160728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.160820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.160906] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.161018] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.161142] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.162168] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.171945] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.172203] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.173260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.173391] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.173514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.173636] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.173757] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.173878] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.174029] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.174150] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.174271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.174391] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.174510] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.174631] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.174750] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.174871] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.175000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.175121] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.175240] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.175360] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.175479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.175605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.175732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.175855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.175985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.176108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.176231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.176354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.176477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.176603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.176729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.176854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.176984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.177110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.177242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.177372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.177503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.177631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.177758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.177882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.178013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.178136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.178263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.178388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.178512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.178636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.178764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.178888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.179027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.179115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.179200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.179279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.179357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.179437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.179517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.179596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.179674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.179752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.179828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.179906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.179996] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.180112] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.180117] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=57085, lrc_seqno=57085, guc_id=0, flags=0x73 in no process [-1] <7> [234.180119] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.180178] ------------[ cut here ]------------ <4> [234.180179] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.180180] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:42/3216 <4> [234.180253] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [234.180317] efi_pstore nfnetlink autofs4 <4> [234.180321] CPU: 4 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [234.180324] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.180325] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.180327] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.180332] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.180403] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.180404] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [234.180407] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.180408] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [234.180409] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.180410] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.180411] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [234.180413] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [234.180414] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.180416] CR2: 000072a0f00740e8 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [234.180417] PKRU: 55555554 <4> [234.180418] Call Trace: <4> [234.180419] <TASK> <4> [234.180423] ? lock_sync+0x100/0x100 <4> [234.180428] ? lock_release+0xd0/0x2b0 <4> [234.180433] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.180439] process_one_work+0x239/0x760 <4> [234.180445] worker_thread+0x200/0x3f0 <4> [234.180448] ? __pfx_worker_thread+0x10/0x10 <4> [234.180450] kthread+0x10d/0x150 <4> [234.180453] ? __pfx_kthread+0x10/0x10 <4> [234.180457] ret_from_fork+0x3d4/0x480 <4> [234.180459] ? __pfx_kthread+0x10/0x10 <4> [234.180463] ret_from_fork_asm+0x1a/0x30 <4> [234.180470] </TASK> <4> [234.180471] irq event stamp: 1346377 <4> [234.180472] hardirqs last enabled at (1346383): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [234.180475] hardirqs last disabled at (1346388): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [234.180477] softirqs last enabled at (1345534): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.180480] softirqs last disabled at (1345529): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.180482] ---[ end trace 0000000000000000 ]--- <5> [234.181068] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=57140, lrc_seqno=57140, guc_id=0, flags=0x73 in no process [-1] <7> [234.181071] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.181129] ------------[ cut here ]------------ <4> [234.181130] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.181131] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:42/3216 <4> [234.181201] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [234.181263] efi_pstore nfnetlink autofs4 <4> [234.181267] CPU: 4 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [234.181269] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.181270] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.181271] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.181276] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.181346] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.181347] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [234.181349] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.181350] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [234.181352] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.181353] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.181354] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [234.181355] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [234.181357] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.181358] CR2: 000072a0f00740e8 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [234.181359] PKRU: 55555554 <4> [234.181360] Call Trace: <4> [234.181361] <TASK> <4> [234.181365] ? lock_sync+0x100/0x100 <4> [234.181369] ? lock_release+0xd0/0x2b0 <4> [234.181374] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.181379] process_one_work+0x239/0x760 <4> [234.181385] worker_thread+0x200/0x3f0 <4> [234.181388] ? __pfx_worker_thread+0x10/0x10 <4> [234.181390] kthread+0x10d/0x150 <4> [234.181393] ? __pfx_kthread+0x10/0x10 <4> [234.181396] ret_from_fork+0x3d4/0x480 <4> [234.181398] ? __pfx_kthread+0x10/0x10 <4> [234.181402] ret_from_fork_asm+0x1a/0x30 <4> [234.181409] </TASK> <4> [234.181410] irq event stamp: 1349031 <4> [234.181411] hardirqs last enabled at (1349037): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [234.181414] hardirqs last disabled at (1349042): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [234.181416] softirqs last enabled at (1347818): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.181418] softirqs last disabled at (1347813): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.181420] ---[ end trace 0000000000000000 ]--- <6> [234.181422] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.181490] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.181496] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.182527] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.182648] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [234.182760] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.182973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.183065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.183160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.183250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.183338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.183423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.183507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.183592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.183674] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.183768] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.183884] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.184931] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.195020] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.195266] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.196296] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.196376] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.196453] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.196529] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.196605] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.196681] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.196759] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.196837] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.196914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.197004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.197080] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.197155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.197228] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.197301] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.197373] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.197445] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.197517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.197589] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.197663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.197746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.197829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.197910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.198003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.198080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.198157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.198233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.198310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.198395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.198477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.198557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.198637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.198716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.198801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.198903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.199011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.199103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.199187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.199267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.199346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.199421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.199501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.199579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.199656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.199734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.199814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.199890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.199974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.200050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.200127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.200202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.200278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.200356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.200436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.200516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.200594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.200671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.200747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.200825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.200907] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.201029] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.201033] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=57140, lrc_seqno=57140, guc_id=0, flags=0x73 in no process [-1] <7> [234.201036] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.201095] ------------[ cut here ]------------ <4> [234.201096] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.201098] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:48/3222 <4> [234.201168] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [234.201233] efi_pstore nfnetlink autofs4 <4> [234.201238] CPU: 0 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [234.201241] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.201243] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.201244] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.201250] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.201319] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.201321] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [234.201324] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.201325] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [234.201327] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.201328] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.201329] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [234.201331] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [234.201333] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.201335] CR2: 0000738bc2804ff8 CR3: 0000000122082002 CR4: 0000000000f72ef0 <4> [234.201336] PKRU: 55555554 <4> [234.201338] Call Trace: <4> [234.201339] <TASK> <4> [234.201343] ? lock_sync+0x100/0x100 <4> [234.201348] ? lock_release+0xd0/0x2b0 <4> [234.201353] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.201359] process_one_work+0x239/0x760 <4> [234.201366] worker_thread+0x200/0x3f0 <4> [234.201369] ? __pfx_worker_thread+0x10/0x10 <4> [234.201372] kthread+0x10d/0x150 <4> [234.201375] ? __pfx_kthread+0x10/0x10 <4> [234.201379] ret_from_fork+0x3d4/0x480 <4> [234.201381] ? __pfx_kthread+0x10/0x10 <4> [234.201385] ret_from_fork_asm+0x1a/0x30 <4> [234.201392] </TASK> <4> [234.201394] irq event stamp: 442001 <4> [234.201395] hardirqs last enabled at (442007): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [234.201398] hardirqs last disabled at (442012): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [234.201400] softirqs last enabled at (441080): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.201403] softirqs last disabled at (441073): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.201405] ---[ end trace 0000000000000000 ]--- <6> [234.201407] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.201477] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.201483] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.201900] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.202113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.202198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.202287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.202373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.202459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.202546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.202632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.202718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.202800] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.202895] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.203016] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.204028] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.213974] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.214222] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.215178] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.215257] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.215333] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.215409] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.215486] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.215561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.215635] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.215711] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.215786] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.215861] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.215936] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.216027] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.216101] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.216175] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.216250] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.216327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.216403] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.216479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.216554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.216635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.216716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.216795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.216875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.216956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.217055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.217134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.217211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.217290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.217369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.217447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.217525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.217603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.217686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.217768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.217851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.217931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.218018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.218094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.218171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.218250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.218332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.218410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.218488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.218565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.218645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.218721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.218799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.218879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.218959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.219056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.219133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.219212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.219292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.219372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.219449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.219526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.219601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.219676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.219753] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.219863] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.219867] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=57140, lrc_seqno=57140, guc_id=0, flags=0x73 in no process [-1] <7> [234.219869] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.219928] ------------[ cut here ]------------ <4> [234.219929] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.219930] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:48/3222 <4> [234.220013] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [234.220077] efi_pstore nfnetlink autofs4 <4> [234.220081] CPU: 0 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [234.220084] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.220085] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.220087] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.220092] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.220162] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.220163] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [234.220165] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.220167] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [234.220168] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.220169] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.220170] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [234.220172] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [234.220173] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.220175] CR2: 0000738bc2804ff8 CR3: 0000000122082002 CR4: 0000000000f72ef0 <4> [234.220176] PKRU: 55555554 <4> [234.220177] Call Trace: <4> [234.220178] <TASK> <4> [234.220182] ? lock_sync+0x100/0x100 <4> [234.220187] ? lock_release+0xd0/0x2b0 <4> [234.220192] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.220197] process_one_work+0x239/0x760 <4> [234.220204] worker_thread+0x200/0x3f0 <4> [234.220207] ? __pfx_worker_thread+0x10/0x10 <4> [234.220209] kthread+0x10d/0x150 <4> [234.220212] ? __pfx_kthread+0x10/0x10 <4> [234.220216] ret_from_fork+0x3d4/0x480 <4> [234.220218] ? __pfx_kthread+0x10/0x10 <4> [234.220221] ret_from_fork_asm+0x1a/0x30 <4> [234.220228] </TASK> <4> [234.220229] irq event stamp: 445119 <4> [234.220230] hardirqs last enabled at (445125): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [234.220233] hardirqs last disabled at (445130): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [234.220235] softirqs last enabled at (444216): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.220238] softirqs last disabled at (444211): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.220240] ---[ end trace 0000000000000000 ]--- <5> [234.221753] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=57195, lrc_seqno=57195, guc_id=0, flags=0x73 in no process [-1] <7> [234.221756] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.221819] ------------[ cut here ]------------ <4> [234.221820] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.221822] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:48/3222 <4> [234.221892] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [234.221953] efi_pstore nfnetlink autofs4 <4> [234.221957] CPU: 0 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [234.221960] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.221961] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.221962] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.221967] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.222051] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.222053] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [234.222056] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.222057] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [234.222059] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.222060] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.222062] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [234.222063] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [234.222065] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.222066] CR2: 0000738bc2804ff8 CR3: 0000000122082002 CR4: 0000000000f72ef0 <4> [234.222068] PKRU: 55555554 <4> [234.222069] Call Trace: <4> [234.222070] <TASK> <4> [234.222074] ? lock_sync+0x100/0x100 <4> [234.222078] ? lock_release+0xd0/0x2b0 <4> [234.222084] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.222090] process_one_work+0x239/0x760 <4> [234.222096] worker_thread+0x200/0x3f0 <4> [234.222099] ? __pfx_worker_thread+0x10/0x10 <4> [234.222102] kthread+0x10d/0x150 <4> [234.222105] ? __pfx_kthread+0x10/0x10 <4> [234.222109] ret_from_fork+0x3d4/0x480 <4> [234.222111] ? __pfx_kthread+0x10/0x10 <4> [234.222114] ret_from_fork_asm+0x1a/0x30 <4> [234.222122] </TASK> <4> [234.222123] irq event stamp: 447783 <4> [234.222125] hardirqs last enabled at (447789): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [234.222127] hardirqs last disabled at (447794): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [234.222130] softirqs last enabled at (444216): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.222132] softirqs last disabled at (444211): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.222135] ---[ end trace 0000000000000000 ]--- <7> [234.222148] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.222251] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <6> [234.222349] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.222422] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.222428] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.222476] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.222682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.222774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.222867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.222955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.223052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.223138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.223225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.223315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.223402] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.223496] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.223611] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.224620] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.234989] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.235238] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.236262] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.236347] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.236427] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.236505] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.236581] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.236656] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.236730] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.236803] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.236878] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.236950] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.237033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.237105] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.237178] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.237252] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.237325] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.237398] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.237471] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.237544] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.237617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.237698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.237778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.237858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.237941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.238029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.238106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.238182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.238257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.238335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.238417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.238498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.238577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.238658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.238741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.238827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.238910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.238992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.239070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.239147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.239223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.239297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.239375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.239457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.239536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.239614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.239694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.239771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.239848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.239923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.240037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.240113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.240190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.240273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.240353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.240433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.240511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.240592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.240669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.240748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.240832] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.240946] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.240950] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=57195, lrc_seqno=57195, guc_id=0, flags=0x73 in no process [-1] <7> [234.240953] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.241874] ------------[ cut here ]------------ <4> [234.241876] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.241877] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:42/3216 <4> [234.241957] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [234.242041] efi_pstore nfnetlink autofs4 <4> [234.242046] CPU: 4 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [234.242049] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.242051] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.242052] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.242058] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.242129] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.242131] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [234.242134] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.242136] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [234.242137] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.242139] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.242140] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [234.242142] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [234.242143] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.242145] CR2: 000072a0f00740e8 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [234.242147] PKRU: 55555554 <4> [234.242148] Call Trace: <4> [234.242149] <TASK> <4> [234.242153] ? lock_sync+0x100/0x100 <4> [234.242158] ? lock_release+0xd0/0x2b0 <4> [234.242164] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.242170] process_one_work+0x239/0x760 <4> [234.242176] worker_thread+0x200/0x3f0 <4> [234.242179] ? __pfx_worker_thread+0x10/0x10 <4> [234.242182] kthread+0x10d/0x150 <4> [234.242184] ? __pfx_kthread+0x10/0x10 <4> [234.242188] ret_from_fork+0x3d4/0x480 <4> [234.242190] ? __pfx_kthread+0x10/0x10 <4> [234.242193] ret_from_fork_asm+0x1a/0x30 <4> [234.242201] </TASK> <4> [234.242202] irq event stamp: 1355523 <4> [234.242203] hardirqs last enabled at (1355529): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [234.242206] hardirqs last disabled at (1355534): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [234.242208] softirqs last enabled at (1354756): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.242211] softirqs last disabled at (1354749): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.242213] ---[ end trace 0000000000000000 ]--- <6> [234.242215] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.242285] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.242292] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.242512] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.242615] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [234.242725] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.242929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.243026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.243118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.243205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.243290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.243374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.243457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.243542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.243622] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.243716] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.243832] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.244838] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.255004] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.255254] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.256283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.256363] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.256438] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.256515] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.256591] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.256666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.256741] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.256816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.256892] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.256970] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.257067] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.257142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.257216] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.257290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.257364] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.257437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.257511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.257585] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.257657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.257737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.257818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.257898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.257978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.258066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.258144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.258222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.258299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.258380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.258464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.258544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.258623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.258701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.258786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.258869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.258952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.259041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.259120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.259196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.259272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.259347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.259429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.259507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.259585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.259662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.259743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.259820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.259900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.259980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.260072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.260151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.260227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.260310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.260389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.260466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.260541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.260620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.260696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.260772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.260855] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.260966] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.260970] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=57195, lrc_seqno=57195, guc_id=0, flags=0x73 in no process [-1] <7> [234.260972] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.261889] ------------[ cut here ]------------ <4> [234.261890] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.261892] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:47/3221 <4> [234.261966] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [234.262038] efi_pstore nfnetlink autofs4 <4> [234.262042] CPU: 5 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [234.262045] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.262046] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.262048] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.262053] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.262122] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.262124] RSP: 0018:ffffc90007163ca0 EFLAGS: 00010246 <4> [234.262126] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.262127] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [234.262129] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.262130] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.262131] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [234.262132] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000 <4> [234.262134] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.262135] CR2: 0000738bc1c03c98 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [234.262137] PKRU: 55555554 <4> [234.262138] Call Trace: <4> [234.262139] <TASK> <4> [234.262143] ? lock_sync+0x100/0x100 <4> [234.262148] ? lock_release+0xd0/0x2b0 <4> [234.262153] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.262159] process_one_work+0x239/0x760 <4> [234.262165] worker_thread+0x200/0x3f0 <4> [234.262168] ? __pfx_worker_thread+0x10/0x10 <4> [234.262170] kthread+0x10d/0x150 <4> [234.262174] ? __pfx_kthread+0x10/0x10 <4> [234.262177] ret_from_fork+0x3d4/0x480 <4> [234.262179] ? __pfx_kthread+0x10/0x10 <4> [234.262183] ret_from_fork_asm+0x1a/0x30 <4> [234.262190] </TASK> <4> [234.262191] irq event stamp: 503011 <4> [234.262192] hardirqs last enabled at (503017): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [234.262195] hardirqs last disabled at (503022): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [234.262197] softirqs last enabled at (502534): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.262200] softirqs last disabled at (502527): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.262202] ---[ end trace 0000000000000000 ]--- <7> [234.262214] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.262318] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <5> [234.263083] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=57250, lrc_seqno=57250, guc_id=0, flags=0x73 in no process [-1] <7> [234.263088] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.263160] ------------[ cut here ]------------ <4> [234.263161] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.263163] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:42/3216 <4> [234.263243] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [234.263317] efi_pstore nfnetlink autofs4 <4> [234.263322] CPU: 6 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [234.263325] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.263327] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.263328] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.263334] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.263411] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.263413] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [234.263415] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.263417] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [234.263419] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.263420] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.263421] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [234.263423] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [234.263425] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.263426] CR2: 000070b5c3459008 CR3: 0000000130336003 CR4: 0000000000f72ef0 <4> [234.263428] PKRU: 55555554 <4> [234.263429] Call Trace: <4> [234.263431] <TASK> <4> [234.263435] ? lock_sync+0x100/0x100 <4> [234.263440] ? lock_release+0xd0/0x2b0 <4> [234.263446] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.263451] process_one_work+0x239/0x760 <4> [234.263458] worker_thread+0x200/0x3f0 <4> [234.263461] ? __pfx_worker_thread+0x10/0x10 <4> [234.263463] kthread+0x10d/0x150 <4> [234.263467] ? __pfx_kthread+0x10/0x10 <4> [234.263470] ret_from_fork+0x3d4/0x480 <4> [234.263473] ? __pfx_kthread+0x10/0x10 <4> [234.263476] ret_from_fork_asm+0x1a/0x30 <4> [234.263484] </TASK> <4> [234.263485] irq event stamp: 1357641 <4> [234.263486] hardirqs last enabled at (1357647): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [234.263489] hardirqs last disabled at (1357652): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [234.263491] softirqs last enabled at (1356628): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.263494] softirqs last disabled at (1356619): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.263496] ---[ end trace 0000000000000000 ]--- <6> [234.263498] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.263573] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.263579] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.263716] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.263922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.264015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.264106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.264192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.264278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.264363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.264446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.264535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.264619] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.264716] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.264832] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.265842] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.276019] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.276268] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.277276] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.277355] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.277430] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.277506] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.277582] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.277658] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.277735] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.277811] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.277886] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.277961] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.278041] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.278115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.278189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.278261] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.278334] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.278408] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.278484] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.278559] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.278633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.278714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.278794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.278872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.278950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.279028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.279106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.279186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.279264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.279344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.279424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.279502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.279581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.279661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.279744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.279827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.279909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.279989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.280075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.280155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.280237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.280314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.280394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.280471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.280549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.280624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.280703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.280779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.280855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.280930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.281008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.281096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.281172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.281250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.281325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.281402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.281476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.281553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.281629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.281709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.281790] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.281902] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.281906] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=57250, lrc_seqno=57250, guc_id=0, flags=0x73 in no process [-1] <7> [234.281908] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.281966] ------------[ cut here ]------------ <4> [234.281967] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.281968] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:47/3221 <4> [234.282047] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [234.282110] efi_pstore nfnetlink autofs4 <4> [234.282115] CPU: 5 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [234.282117] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.282119] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.282120] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.282125] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.282195] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.282196] RSP: 0018:ffffc90007163ca0 EFLAGS: 00010246 <4> [234.282198] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.282200] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [234.282201] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.282202] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.282203] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [234.282205] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000 <4> [234.282206] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.282208] CR2: 0000738bc1c03c98 CR3: 000000000344c004 CR4: 0000000000f72ef0 <4> [234.282209] PKRU: 55555554 <4> [234.282210] Call Trace: <4> [234.282212] <TASK> <4> [234.282216] ? lock_sync+0x100/0x100 <4> [234.282220] ? lock_release+0xd0/0x2b0 <4> [234.282226] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.282231] process_one_work+0x239/0x760 <4> [234.282237] worker_thread+0x200/0x3f0 <4> [234.282240] ? __pfx_worker_thread+0x10/0x10 <4> [234.282242] kthread+0x10d/0x150 <4> [234.282245] ? __pfx_kthread+0x10/0x10 <4> [234.282249] ret_from_fork+0x3d4/0x480 <4> [234.282251] ? __pfx_kthread+0x10/0x10 <4> [234.282254] ret_from_fork_asm+0x1a/0x30 <4> [234.282262] </TASK> <4> [234.282263] irq event stamp: 508203 <4> [234.282264] hardirqs last enabled at (508209): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [234.282267] hardirqs last disabled at (508214): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [234.282270] softirqs last enabled at (507460): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.282273] softirqs last disabled at (507455): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.282275] ---[ end trace 0000000000000000 ]--- <6> [234.283026] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.283153] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.283164] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.283290] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.283392] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [234.283499] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.283707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.283800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.283895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.283986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.284091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.284178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.284264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.284349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.284432] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.284526] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.284646] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.285652] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.296035] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.296285] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.297316] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.297397] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.297473] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.297549] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.297625] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.297699] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.297775] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.297850] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.297925] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.297998] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.298085] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.298158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.298233] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.298307] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.298381] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.298455] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.298530] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.298607] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.298681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.298763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.298845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.298923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.299003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.299188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.299271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.299351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.299429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.299508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.299589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.299668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.299749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.299831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.299918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.300004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.300183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.300265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.300348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.300430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.300510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.300587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.300667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.300745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.300823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.300899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.300980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.301068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.301146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.301221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.301299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.301378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.301455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.301534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.301612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.301689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.301764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.301841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.301916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.301994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.302086] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.302199] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.302203] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=57250, lrc_seqno=57250, guc_id=0, flags=0x73 in no process [-1] <7> [234.302206] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.302265] ------------[ cut here ]------------ <4> [234.302267] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.302268] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:48/3222 <4> [234.302341] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [234.302407] efi_pstore nfnetlink autofs4 <4> [234.302412] CPU: 0 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [234.302416] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.302417] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.302419] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.302424] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.302494] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.302496] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [234.302499] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.302500] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [234.302501] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.302503] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.302504] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [234.302505] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [234.302507] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.302508] CR2: 0000738bc2804ff8 CR3: 0000000122082002 CR4: 0000000000f72ef0 <4> [234.302510] PKRU: 55555554 <4> [234.302511] Call Trace: <4> [234.302512] <TASK> <4> [234.302516] ? lock_sync+0x100/0x100 <4> [234.302520] ? lock_release+0xd0/0x2b0 <4> [234.302526] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.302531] process_one_work+0x239/0x760 <4> [234.302538] worker_thread+0x200/0x3f0 <4> [234.302540] ? __pfx_worker_thread+0x10/0x10 <4> [234.302543] kthread+0x10d/0x150 <4> [234.302546] ? __pfx_kthread+0x10/0x10 <4> [234.302549] ret_from_fork+0x3d4/0x480 <4> [234.302551] ? __pfx_kthread+0x10/0x10 <4> [234.302555] ret_from_fork_asm+0x1a/0x30 <4> [234.302562] </TASK> <4> [234.302563] irq event stamp: 454701 <4> [234.302565] hardirqs last enabled at (454707): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [234.302567] hardirqs last disabled at (454712): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [234.302570] softirqs last enabled at (453858): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.302572] softirqs last disabled at (453847): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.302574] ---[ end trace 0000000000000000 ]--- <5> [234.304061] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=57305, lrc_seqno=57305, guc_id=0, flags=0x73 in no process [-1] <7> [234.304064] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.304135] ------------[ cut here ]------------ <4> [234.304136] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.304137] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:48/3222 <4> [234.304207] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [234.304270] efi_pstore nfnetlink autofs4 <4> [234.304275] CPU: 0 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [234.304278] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.304279] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.304281] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.304286] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.304354] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.304355] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [234.304358] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.304359] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [234.304361] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.304362] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.304363] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [234.304365] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [234.304366] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.304368] CR2: 0000738bc2804ff8 CR3: 0000000122082002 CR4: 0000000000f72ef0 <4> [234.304370] PKRU: 55555554 <4> [234.304371] Call Trace: <4> [234.304372] <TASK> <4> [234.304376] ? lock_sync+0x100/0x100 <4> [234.304380] ? lock_release+0xd0/0x2b0 <4> [234.304386] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.304392] process_one_work+0x239/0x760 <4> [234.304398] worker_thread+0x200/0x3f0 <4> [234.304401] ? __pfx_worker_thread+0x10/0x10 <4> [234.304404] kthread+0x10d/0x150 <4> [234.304407] ? __pfx_kthread+0x10/0x10 <4> [234.304410] ret_from_fork+0x3d4/0x480 <4> [234.304413] ? __pfx_kthread+0x10/0x10 <4> [234.304416] ret_from_fork_asm+0x1a/0x30 <4> [234.304423] </TASK> <4> [234.304425] irq event stamp: 457411 <4> [234.304426] hardirqs last enabled at (457417): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [234.304429] hardirqs last disabled at (457422): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [234.304431] softirqs last enabled at (453858): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.304434] softirqs last disabled at (453847): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.304437] ---[ end trace 0000000000000000 ]--- <6> [234.304439] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.304509] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.304514] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.304741] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.304845] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [234.304950] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.305154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.305244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.305337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.305424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.305513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.305600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.305686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.305772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.305856] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.305951] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.306071] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.307080] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.317052] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.317303] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.318295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.318376] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.318453] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.318530] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.318605] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.318681] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.318756] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.318830] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.318905] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.318983] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.319065] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.319142] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.319218] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.319292] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.319365] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.319438] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.319511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.319583] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.319657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.319737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.319818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.319898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.319978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.320062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.320139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.320215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.320291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.320370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.320448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.320525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.320605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.320687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.320773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.320856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.320940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.321020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.321112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.321189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.321265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.321343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.321425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.321506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.321584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.321660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.321740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.321816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.321892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.321968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.322049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.322125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.322198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.322275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.322351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.322428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.322505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.322584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.322660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.322735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.322814] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.322926] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.322930] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=57305, lrc_seqno=57305, guc_id=0, flags=0x73 in no process [-1] <7> [234.322932] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.322991] ------------[ cut here ]------------ <4> [234.322992] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.322993] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:48/3222 <4> [234.323072] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [234.323136] efi_pstore nfnetlink autofs4 <4> [234.323140] CPU: 0 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [234.323143] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.323144] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.323146] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.323151] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.323221] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.323223] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [234.323225] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.323227] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [234.323228] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.323229] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.323230] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [234.323232] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000 <4> [234.323233] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.323235] CR2: 0000738bc2804ff8 CR3: 0000000122082002 CR4: 0000000000f72ef0 <4> [234.323236] PKRU: 55555554 <4> [234.323237] Call Trace: <4> [234.323238] <TASK> <4> [234.323242] ? lock_sync+0x100/0x100 <4> [234.323247] ? lock_release+0xd0/0x2b0 <4> [234.323252] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.323258] process_one_work+0x239/0x760 <4> [234.323264] worker_thread+0x200/0x3f0 <4> [234.323267] ? __pfx_worker_thread+0x10/0x10 <4> [234.323270] kthread+0x10d/0x150 <4> [234.323273] ? __pfx_kthread+0x10/0x10 <4> [234.323276] ret_from_fork+0x3d4/0x480 <4> [234.323279] ? __pfx_kthread+0x10/0x10 <4> [234.323282] ret_from_fork_asm+0x1a/0x30 <4> [234.323289] </TASK> <4> [234.323291] irq event stamp: 460507 <4> [234.323292] hardirqs last enabled at (460513): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [234.323295] hardirqs last disabled at (460518): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [234.323297] softirqs last enabled at (459764): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.323300] softirqs last disabled at (459753): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.323303] ---[ end trace 0000000000000000 ]--- <6> [234.324073] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.324186] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.324197] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.324324] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.324430] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [234.324586] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.324819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.324918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.325017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.325124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.325216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.325306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.325396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.325487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.325574] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.325673] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.325794] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.326805] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.337404] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.337659] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.338659] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.338744] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.338823] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.338903] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.338984] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.339068] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.339147] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.339227] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.339307] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.339385] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.339464] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.339543] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.339624] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.339702] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.339781] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.339860] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.339938] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.340016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.340102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.340188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.340274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.340358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.340443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.340530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.340614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.340697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.340779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.340863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.340947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.341030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.341120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.341202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.341290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.341378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.341465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.341549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.341632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.341711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.341793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.341872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.341956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.342038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.342131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.342215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.342301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.342383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.342464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.342544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.342627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.342707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.342787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.342870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.342951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.343031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.343118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.343201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.343286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.343367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.343452] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.343567] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.343572] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=57305, lrc_seqno=57305, guc_id=0, flags=0x73 in no process [-1] <7> [234.343574] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.343637] ------------[ cut here ]------------ <4> [234.343638] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.343639] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:48/3222 <4> [234.343714] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [234.343779] efi_pstore nfnetlink autofs4 <4> [234.343784] CPU: 4 UID: 0 PID: 3222 Comm: kworker/u64:48 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [234.343787] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.343788] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.343790] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.343795] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.343869] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.343871] RSP: 0018:ffffc9000716bca0 EFLAGS: 00010246 <4> [234.343873] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.343875] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [234.343876] RBP: ffffc9000716bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.343877] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.343879] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [234.343880] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000 <4> [234.343882] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.343883] CR2: 000072a0f00740e8 CR3: 000000000344c002 CR4: 0000000000f72ef0 <4> [234.343885] PKRU: 55555554 <4> [234.343886] Call Trace: <4> [234.343887] <TASK> <4> [234.343891] ? lock_sync+0x100/0x100 <4> [234.343896] ? lock_release+0xd0/0x2b0 <4> [234.343902] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.343908] process_one_work+0x239/0x760 <4> [234.343914] worker_thread+0x200/0x3f0 <4> [234.343917] ? __pfx_worker_thread+0x10/0x10 <4> [234.343919] kthread+0x10d/0x150 <4> [234.343923] ? __pfx_kthread+0x10/0x10 <4> [234.343927] ret_from_fork+0x3d4/0x480 <4> [234.343929] ? __pfx_kthread+0x10/0x10 <4> [234.343932] ret_from_fork_asm+0x1a/0x30 <4> [234.343940] </TASK> <4> [234.343941] irq event stamp: 463621 <4> [234.343942] hardirqs last enabled at (463627): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [234.343946] hardirqs last disabled at (463632): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [234.343948] softirqs last enabled at (462672): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.343951] softirqs last disabled at (462665): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.343953] ---[ end trace 0000000000000000 ]--- <5> [234.344541] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=57360, lrc_seqno=57360, guc_id=0, flags=0x73 in no process [-1] <7> [234.344546] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.344769] ------------[ cut here ]------------ <4> [234.344771] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.344773] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:47/3221 <4> [234.344849] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [234.344919] efi_pstore nfnetlink autofs4 <4> [234.344924] CPU: 6 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [234.344928] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.344929] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.344931] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.344939] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.345015] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.345018] RSP: 0018:ffffc90007163ca0 EFLAGS: 00010246 <4> [234.345022] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.345024] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [234.345026] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.345027] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.345029] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [234.345031] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [234.345034] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.345036] CR2: 000070b5c3459008 CR3: 0000000130336003 CR4: 0000000000f72ef0 <4> [234.345038] PKRU: 55555554 <4> [234.345040] Call Trace: <4> [234.345041] <TASK> <4> [234.345046] ? lock_sync+0x100/0x100 <4> [234.345051] ? lock_release+0xd0/0x2b0 <4> [234.345058] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.345072] process_one_work+0x239/0x760 <4> [234.345079] worker_thread+0x200/0x3f0 <4> [234.345082] ? __pfx_worker_thread+0x10/0x10 <4> [234.345085] kthread+0x10d/0x150 <4> [234.345089] ? __pfx_kthread+0x10/0x10 <4> [234.345093] ret_from_fork+0x3d4/0x480 <4> [234.345096] ? __pfx_kthread+0x10/0x10 <4> [234.345101] ret_from_fork_asm+0x1a/0x30 <4> [234.345110] </TASK> <4> [234.345112] irq event stamp: 513919 <4> [234.345114] hardirqs last enabled at (513925): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [234.345118] hardirqs last disabled at (513930): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [234.345121] softirqs last enabled at (512608): [<ffffffff8133ac33>] kernel_fpu_end+0x53/0x70 <4> [234.345125] softirqs last disabled at (512606): [<ffffffff8133b344>] kernel_fpu_begin_mask+0xc4/0x120 <4> [234.345128] ---[ end trace 0000000000000000 ]--- <6> [234.345131] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.345219] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.345235] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.345559] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.345669] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [234.345780] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.345981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.346083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.346175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.346263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.346351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.346439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.346528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.346618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.346701] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.346796] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.346913] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.347921] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.358078] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.358328] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.359296] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.359376] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.359453] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.359530] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.359604] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.359678] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.359752] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.359827] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.359901] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.359976] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.360051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.360137] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.360214] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.360289] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.360363] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.360436] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.360510] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.360583] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.360658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.360739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.360819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.360899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.360981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.361059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.361149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.361226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.361303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.361381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.361461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.361541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.361622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.361702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.361786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.361870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.361954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.362034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.362139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.362216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.362291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.362366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.362444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.362521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.362600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.362682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.362766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.362844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.362922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.362998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.363078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.363153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.363229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.363308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.363384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.363461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.363541] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.363622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.363698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.363773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.363854] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.363966] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.363971] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=57360, lrc_seqno=57360, guc_id=0, flags=0x73 in no process [-1] <7> [234.363973] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.364032] ------------[ cut here ]------------ <4> [234.364033] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.364035] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:47/3221 <4> [234.364116] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [234.364192] efi_pstore nfnetlink autofs4 <4> [234.364196] CPU: 6 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [234.364199] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.364201] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.364202] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.364208] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.364277] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.364279] RSP: 0018:ffffc90007163ca0 EFLAGS: 00010246 <4> [234.364282] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.364283] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [234.364284] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.364286] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.364287] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [234.364288] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [234.364290] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.364291] CR2: 000070b5c3459008 CR3: 0000000130336003 CR4: 0000000000f72ef0 <4> [234.364293] PKRU: 55555554 <4> [234.364294] Call Trace: <4> [234.364295] <TASK> <4> [234.364299] ? lock_sync+0x100/0x100 <4> [234.364303] ? lock_release+0xd0/0x2b0 <4> [234.364308] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.364314] process_one_work+0x239/0x760 <4> [234.364320] worker_thread+0x200/0x3f0 <4> [234.364322] ? __pfx_worker_thread+0x10/0x10 <4> [234.364325] kthread+0x10d/0x150 <4> [234.364328] ? __pfx_kthread+0x10/0x10 <4> [234.364331] ret_from_fork+0x3d4/0x480 <4> [234.364333] ? __pfx_kthread+0x10/0x10 <4> [234.364337] ret_from_fork_asm+0x1a/0x30 <4> [234.364344] </TASK> <4> [234.364345] irq event stamp: 517189 <4> [234.364346] hardirqs last enabled at (517195): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [234.364349] hardirqs last disabled at (517200): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [234.364351] softirqs last enabled at (516192): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.364354] softirqs last disabled at (516061): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.364356] ---[ end trace 0000000000000000 ]--- <6> [234.365288] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.365361] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.365372] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.365424] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.365526] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [234.365633] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.365838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.365928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.366020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.366114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.366201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.366287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.366372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.366459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.366542] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.366637] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.366753] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.367758] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.378092] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.378340] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.379325] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.379403] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.379479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.379556] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.379632] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.379707] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.379781] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.379855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.379930] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.380004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.380077] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.380166] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.380244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.380321] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.380397] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.380470] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.380546] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.380622] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.380696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.380777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.380858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.380937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.381016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.381103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.381181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.381259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.381338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.381417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.381501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.381584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.381663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.381744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.381828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.381914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.382002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.382084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.382178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.382256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.382332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.382408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.382487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.382567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.382647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.382726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.382809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.382886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.382963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.383039] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.383125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.383205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.383283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.383363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.383440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.383517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.383592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.383668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.383742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.383816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.383894] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.384003] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.384007] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=57360, lrc_seqno=57360, guc_id=0, flags=0x73 in no process [-1] <7> [234.384009] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.384069] ------------[ cut here ]------------ <4> [234.384070] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.384072] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:47/3221 <4> [234.384154] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [234.384229] efi_pstore nfnetlink autofs4 <4> [234.384234] CPU: 6 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [234.384237] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.384238] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.384239] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.384245] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.384316] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.384318] RSP: 0018:ffffc90007163ca0 EFLAGS: 00010246 <4> [234.384320] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.384322] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [234.384323] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.384324] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.384325] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [234.384327] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [234.384328] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.384330] CR2: 000070b5c3459008 CR3: 0000000130336003 CR4: 0000000000f72ef0 <4> [234.384331] PKRU: 55555554 <4> [234.384332] Call Trace: <4> [234.384333] <TASK> <4> [234.384337] ? lock_sync+0x100/0x100 <4> [234.384342] ? lock_release+0xd0/0x2b0 <4> [234.384347] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.384352] process_one_work+0x239/0x760 <4> [234.384359] worker_thread+0x200/0x3f0 <4> [234.384362] ? __pfx_worker_thread+0x10/0x10 <4> [234.384364] kthread+0x10d/0x150 <4> [234.384367] ? __pfx_kthread+0x10/0x10 <4> [234.384370] ret_from_fork+0x3d4/0x480 <4> [234.384372] ? __pfx_kthread+0x10/0x10 <4> [234.384376] ret_from_fork_asm+0x1a/0x30 <4> [234.384383] </TASK> <4> [234.384384] irq event stamp: 520345 <4> [234.384385] hardirqs last enabled at (520351): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [234.384388] hardirqs last disabled at (520356): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [234.384390] softirqs last enabled at (519350): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.384393] softirqs last disabled at (519343): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.384395] ---[ end trace 0000000000000000 ]--- <5> [234.384986] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=57415, lrc_seqno=57415, guc_id=0, flags=0x73 in no process [-1] <7> [234.384994] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.385242] ------------[ cut here ]------------ <4> [234.385246] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.385249] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#12: kworker/u64:42/3216 <4> [234.385376] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [234.385478] efi_pstore nfnetlink autofs4 <4> [234.385487] CPU: 12 UID: 0 PID: 3216 Comm: kworker/u64:42 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [234.385493] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.385496] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.385498] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.385510] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.385626] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.385629] RSP: 0018:ffffc9000713bca0 EFLAGS: 00010246 <4> [234.385633] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.385635] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [234.385637] RBP: ffffc9000713bdb0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.385639] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.385641] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [234.385643] FS: 0000000000000000(0000) GS:ffff8888db297000(0000) knlGS:0000000000000000 <4> [234.385645] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.385647] CR2: 000072a0f00760d8 CR3: 000000000344c003 CR4: 0000000000f72ef0 <4> [234.385649] PKRU: 55555554 <4> [234.385651] Call Trace: <4> [234.385653] <TASK> <4> [234.385660] ? lock_sync+0x100/0x100 <4> [234.385668] ? lock_release+0xd0/0x2b0 <4> [234.385677] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.385687] process_one_work+0x239/0x760 <4> [234.385698] worker_thread+0x200/0x3f0 <4> [234.385702] ? __pfx_worker_thread+0x10/0x10 <4> [234.385706] kthread+0x10d/0x150 <4> [234.385711] ? __pfx_kthread+0x10/0x10 <4> [234.385716] ret_from_fork+0x3d4/0x480 <4> [234.385719] ? __pfx_kthread+0x10/0x10 <4> [234.385724] ret_from_fork_asm+0x1a/0x30 <4> [234.385736] </TASK> <4> [234.385739] irq event stamp: 1362871 <4> [234.385740] hardirqs last enabled at (1362877): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [234.385747] hardirqs last disabled at (1362882): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [234.385750] softirqs last enabled at (1362110): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.385754] softirqs last disabled at (1362101): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.385757] ---[ end trace 0000000000000000 ]--- <6> [234.385761] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.385876] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.385885] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.385980] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations <7> [234.386085] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed <7> [234.386205] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.386407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.386498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.386592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.386679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.386765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.386849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.386934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.387020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.387105] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.387199] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.387315] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled <7> [234.388336] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152) <7> [234.398107] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034 <7> [234.398358] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled <7> [234.399362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1 <7> [234.399441] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16 <7> [234.399517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc <7> [234.399594] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c <7> [234.399670] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130 <7> [234.399745] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c <7> [234.399819] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100 <7> [234.399893] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100 <7> [234.399970] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100 <7> [234.400046] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100 <7> [234.400162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100 <7> [234.400237] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100 <7> [234.400310] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100 <7> [234.400384] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100 <7> [234.400457] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100 <7> [234.400531] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100 <7> [234.400604] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100 <7> [234.400679] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100 <7> [234.400756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs <7> [234.400839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000 <7> [234.400921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306 <7> [234.400999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080 <7> [234.401079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210 <7> [234.401165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8 <7> [234.401243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc <7> [234.401319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01 <7> [234.401394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c <7> [234.401473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040 <7> [234.401553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200 <7> [234.401631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000 <7> [234.401710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040 <7> [234.401789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002 <7> [234.401876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400 <7> [234.401962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000 <7> [234.402048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100 <7> [234.402133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002 <7> [234.402213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs <7> [234.402289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000 <7> [234.402366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306 <7> [234.402442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080 <7> [234.402521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs <7> [234.402597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000 <7> [234.402673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306 <7> [234.402747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080 <7> [234.402827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs <7> [234.402903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000 <7> [234.402978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308 <7> [234.403053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080 <7> [234.403134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc <7> [234.403208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01 <7> [234.403282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c <7> [234.403360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs <7> [234.403435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000 <7> [234.403510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308 <7> [234.403585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080 <7> [234.403664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc <7> [234.403741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01 <7> [234.403819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c <7> [234.403901] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2 <6> [234.404012] xe 0000:03:00.0: [drm] Tile0: GT0: reset done <5> [234.404016] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=57415, lrc_seqno=57415, guc_id=0, flags=0x73 in no process [-1] <7> [234.404018] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken <4> [234.404076] ------------[ cut here ]------------ <4> [234.404077] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out <4> [234.404079] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:47/3221 <4> [234.404159] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse <4> [234.404222] efi_pstore nfnetlink autofs4 <4> [234.404226] CPU: 6 UID: 0 PID: 3221 Comm: kworker/u64:47 Tainted: G S U W L 7.0.0-rc7-lgci-xe-xe-4857-87b52c2ff4f00eff4-debug+ #1 PREEMPT(lazy) <4> [234.404229] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP <4> [234.404230] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024 <4> [234.404231] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched] <4> [234.404236] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe] <4> [234.404306] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49 <4> [234.404308] RSP: 0018:ffffc90007163ca0 EFLAGS: 00010246 <4> [234.404310] RAX: ffffffffa1202f89 RBX: 0000000000000000 RCX: 0000000000000000 <4> [234.404311] RDX: ffff8881040ad290 RSI: ffffffffa1202f89 RDI: ffffffffa1003ef0 <4> [234.404313] RBP: ffffc90007163db0 R08: 0000000000000000 R09: 0000000000000000 <4> [234.404314] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000 <4> [234.404315] R13: ffff8881040ad290 R14: ffff888127458818 R15: 00000000ffffffc2 <4> [234.404316] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000 <4> [234.404318] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033 <4> [234.404319] CR2: 000070b5c3459008 CR3: 0000000130336003 CR4: 0000000000f72ef0 <4> [234.404321] PKRU: 55555554 <4> [234.404322] Call Trace: <4> [234.404323] <TASK> <4> [234.404327] ? lock_sync+0x100/0x100 <4> [234.404331] ? lock_release+0xd0/0x2b0 <4> [234.404337] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched] <4> [234.404342] process_one_work+0x239/0x760 <4> [234.404348] worker_thread+0x200/0x3f0 <4> [234.404351] ? __pfx_worker_thread+0x10/0x10 <4> [234.404353] kthread+0x10d/0x150 <4> [234.404356] ? __pfx_kthread+0x10/0x10 <4> [234.404359] ret_from_fork+0x3d4/0x480 <4> [234.404361] ? __pfx_kthread+0x10/0x10 <4> [234.404365] ret_from_fork_asm+0x1a/0x30 <4> [234.404372] </TASK> <4> [234.404373] irq event stamp: 525853 <4> [234.404374] hardirqs last enabled at (525859): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0 <4> [234.404377] hardirqs last disabled at (525864): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0 <4> [234.404379] softirqs last enabled at (524756): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.404381] softirqs last disabled at (524747): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160 <4> [234.404384] ---[ end trace 0000000000000000 ]--- <6> [234.404385] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe] <6> [234.404455] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued <6> [234.404461] xe 0000:03:00.0: [drm] Tile0: GT0: reset started <7> [234.404868] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped <7> [234.405070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs <7> [234.405163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000 <7> [234.405252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000 <7> [234.405341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440 <7> [234.405429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440 <7> [234.405513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000 <7> [234.405597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f <7> [234.405683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100 <7> [234.405765] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K <7> [234.405859] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K) <7> [234.405977] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled

<4> [232.971286] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [232.971454] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [232.993855] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [232.994013] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.014314] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.014477] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.016386] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.016584] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.036112] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.036264] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.055434] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.055584] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.057477] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.057635] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.076202] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.076353] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.095209] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.095364] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.097033] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.097198] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.118425] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.118570] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.139470] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.139623] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.140428] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.140579] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.160311] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.160467] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.180285] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.180433] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.182358] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.182516] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.201185] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.201338] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.221254] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.221405] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.223484] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.223630] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.242902] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.243060] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.263691] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.263849] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.265668] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core

<4> [233.265913] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.288315] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.288541] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.308362] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.308509] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.310087] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.310234] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.329579] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.329728] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.349338] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.349488] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.351449] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.351610] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.370404] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.370552] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.390688] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.390841] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.392221] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.392422] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.411555] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.411703] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.432087] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.432235] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.433294] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.433502] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.452798] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.452961] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.471944] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.472083] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.473632] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.473774] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.492793] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.492961] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.512814] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.512964] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.514544] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.514708] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.534750] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.534905] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.554588] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.554744] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.556515] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.556677] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.576229] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.576374] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.596528] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.596676] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.597700] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.597875] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.619126] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.619376] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.639341] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.639488] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.641421] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.641572] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.660644] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.660790] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.680745] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.680909] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.682031] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.682219] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.700673] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.700818] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.721014] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.721177] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.722944] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video

<4> [233.723009] snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4

<4> [233.723177] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.745199] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.745424] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.766784] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.766939] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.768690] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.768848] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.787732] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.787917] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.807829] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.807996] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.809068] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.809234] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.829406] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.829560] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.849359] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.849514] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.851554] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.851713] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.870984] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.871132] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.891596] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.891749] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.893458] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.893621] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.913034] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.913233] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.933364] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.933519] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.934472] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.934638] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.953862] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.954010] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.974847] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.974999] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.976663] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.976832] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [233.995750] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [233.995909] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.015799] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [234.015961] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.016998] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [234.017143] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.036216] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [234.036367] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.056842] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [234.056981] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.057901] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [234.058082] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.077288] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [234.077451] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.096979] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [234.097128] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.098738] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [234.098887] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.117906] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [234.118048] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.137463] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [234.137610] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.139051] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [234.139196] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.158159] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [234.158310] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.180253] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [234.180403] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.181201] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [234.181346] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.201168] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [234.201319] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.220013] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [234.220162] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.221892] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [234.222051] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.241957] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [234.242129] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.261966] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [234.262122] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.263243] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [234.263411] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.282047] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [234.282195] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.302341] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [234.302494] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.304207] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [234.304354] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.323072] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [234.323221] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.343714] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [234.343869] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.344849] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [234.345015] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.364116] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [234.364277] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.384154] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [234.384316] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.385376] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [234.385626] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

<4> [234.404159] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp cmdlinepart hid_generic binfmt_misc spi_nor mei_hdcp mei_pxp asus_nb_wmi asus_wmi mtd sparse_keymap kvm_intel platform_profile wmi_bmof kvm irqbypass usbhid snd_hda_intel ghash_clmulni_intel aesni_intel snd_intel_dspcfg hid snd_hda_codec rapl snd_hda_core r8169 video snd_hwdep intel_cstate snd_pcm realtek i2c_i801 snd_timer snd i2c_mux idma64 spi_intel_pci mei_me spi_intel i2c_smbus soundcore mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad intel_vsec acpi_tad dm_multipath msr nvme_fabrics fuse

<4> [234.404306] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 a6 d3 5e e1 48 89 c6 48 8d 3d ac 94 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49

Results for igt@xe_pat@pt-caching