Result: 48 Warning(s)
i915_display_info7 igt_runner7 results7.json results7-xe-load.json guc_logs7.tar i915_display_info_post_exec7 boot7 dmesg7
| Detail | Value |
|---|---|
| Duration | 0.28 seconds |
| Hostname |
shard-bmg-9 |
| Igt-Version |
IGT-Version: 2.4-g1aba4b364 (x86_64) (Linux: 7.0.0-lgci-xe-xe-4926-489e26ada57ce96a2-debug+ x86_64) |
| Out |
Starting dynamic subtest: pipe-D-HDMI-A-3-4-rc-ccs-to-linear Dynamic subtest pipe-D-HDMI-A-3-4-rc-ccs-to-linear: SUCCESS (0.280s) |
| Err |
Starting dynamic subtest: pipe-D-HDMI-A-3-4-rc-ccs-to-linear Dynamic subtest pipe-D-HDMI-A-3-4-rc-ccs-to-linear: SUCCESS (0.280s) |
| Dmesg |
<6> [337.854772] [IGT] kms_flip_tiling: starting dynamic subtest pipe-D-HDMI-A-3-4-rc-ccs-to-linear
<5> [337.855537] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20880, lrc_seqno=20880, guc_id=0, flags=0x73 in no process [-1]
<7> [337.855546] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:556]
<7> [337.855563] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [337.856015] ------------[ cut here ]------------
<4> [337.856023] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [337.856031] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:19/2700
<4> [337.856417] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart coretemp spi_nor asus_nb_wmi mei_hdcp mei_pxp asus_wmi sparse_keymap mtd wmi_bmof platform_profile kvm_intel usbhid kvm irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core snd_hwdep intel_cstate r8169 snd_pcm video snd_timer realtek nls_iso8859_1 i2c_i801 idma64 snd i2c_mux mei_me spi_intel_pci i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_tad intel_vsec pinctrl_alderlake acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [337.856754] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [337.856779] CPU: 0 UID: 0 PID: 2700 Comm: kworker/u64:19 Tainted: G S U W L 7.0.0-lgci-xe-xe-4926-489e26ada57ce96a2-debug+ #1 PREEMPT(lazy)
<4> [337.856795] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [337.856801] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [337.856809] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [337.856835] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [337.856950] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 86 da 5e e1 48 89 c6 48 8d 3d ac 90 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [337.856952] RSP: 0018:ffffc90004a17ca0 EFLAGS: 00010246
<4> [337.856954] RAX: ffffffffa1204833 RBX: 0000000000000000 RCX: 0000000000000000
<4> [337.856956] RDX: ffff888103cc5f10 RSI: ffffffffa1204833 RDI: ffffffffa1003f20
<4> [337.856957] RBP: ffffc90004a17db0 R08: 0000000000000000 R09: 0000000000000000
<4> [337.856958] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [337.856960] R13: ffff888103cc5f10 R14: ffff888156db3818 R15: 00000000ffffffc2
<4> [337.856961] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000
<4> [337.856962] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [337.856964] CR2: 00007b8c3887a000 CR3: 000000000344c003 CR4: 0000000000f72ef0
<4> [337.856965] PKRU: 55555554
<4> [337.856967] Call Trace:
<4> [337.856968] <TASK>
<4> [337.856972] ? lock_sync+0x100/0x100
<4> [337.856978] ? lock_release+0xd0/0x2b0
<4> [337.856984] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [337.856991] process_one_work+0x239/0x760
<4> [337.857016] worker_thread+0x200/0x3f0
<4> [337.857019] ? __pfx_worker_thread+0x10/0x10
<4> [337.857021] kthread+0x10d/0x150
<4> [337.857024] ? __pfx_kthread+0x10/0x10
<4> [337.857028] ret_from_fork+0x3d4/0x480
<4> [337.857030] ? __pfx_kthread+0x10/0x10
<4> [337.857033] ret_from_fork_asm+0x1a/0x30
<4> [337.857041] </TASK>
<4> [337.857042] irq event stamp: 579691
<4> [337.857044] hardirqs last enabled at (579697): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [337.857047] hardirqs last disabled at (579702): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [337.857049] softirqs last enabled at (578922): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [337.857052] softirqs last disabled at (578915): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [337.857054] ---[ end trace 0000000000000000 ]---
<6> [337.857057] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [337.857128] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [337.857138] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [337.857545] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [337.857745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [337.857836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [337.857957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [337.858046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [337.858134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [337.858222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [337.858309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [337.858397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [337.858479] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [337.858574] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [337.858689] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [337.859700] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [337.869848] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [337.870187] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [337.871485] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [337.871636] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [337.871776] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [337.871941] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [337.872076] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [337.872215] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [337.872354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [337.872489] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [337.872624] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [337.872756] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [337.872909] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [337.873036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [337.873161] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [337.873283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [337.873403] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [337.873524] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [337.873642] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [337.873764] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [337.873903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [337.874035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [337.874162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [337.874283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [337.874407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [337.874531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [337.874650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [337.874768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [337.874897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [337.875014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [337.875126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [337.875233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [337.875341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [337.875449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [337.875560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [337.875670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [337.875778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [337.875898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [337.875999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [337.876095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [337.876189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [337.876282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [337.876378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [337.876472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [337.876570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [337.876661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [337.876756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [337.876853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [337.876942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [337.877026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [337.877111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [337.877192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [337.877275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [337.877361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [337.877449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [337.877538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [337.877620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [337.877703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [337.877780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [337.877868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [337.877949] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [337.878063] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [337.878067] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20880, lrc_seqno=20880, guc_id=0, flags=0x73 in no process [-1]
<7> [337.878070] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [337.878128] ------------[ cut here ]------------
<4> [337.878129] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [337.878131] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:19/2700
<4> [337.878204] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart coretemp spi_nor asus_nb_wmi mei_hdcp mei_pxp asus_wmi sparse_keymap mtd wmi_bmof platform_profile kvm_intel usbhid kvm irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core snd_hwdep intel_cstate r8169 snd_pcm video snd_timer realtek nls_iso8859_1 i2c_i801 idma64 snd i2c_mux mei_me spi_intel_pci i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_tad intel_vsec pinctrl_alderlake acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [337.878270] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [337.878275] CPU: 0 UID: 0 PID: 2700 Comm: kworker/u64:19 Tainted: G S U W L 7.0.0-lgci-xe-xe-4926-489e26ada57ce96a2-debug+ #1 PREEMPT(lazy)
<4> [337.878278] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [337.878279] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [337.878280] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [337.878286] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [337.878356] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 86 da 5e e1 48 89 c6 48 8d 3d ac 90 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [337.878358] RSP: 0018:ffffc90004a17ca0 EFLAGS: 00010246
<4> [337.878360] RAX: ffffffffa1204833 RBX: 0000000000000000 RCX: 0000000000000000
<4> [337.878362] RDX: ffff888103cc5f10 RSI: ffffffffa1204833 RDI: ffffffffa1003f20
<4> [337.878363] RBP: ffffc90004a17db0 R08: 0000000000000000 R09: 0000000000000000
<4> [337.878364] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [337.878366] R13: ffff888103cc5f10 R14: ffff888156db3818 R15: 00000000ffffffc2
<4> [337.878367] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000
<4> [337.878369] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [337.878370] CR2: 00007b8c3887a000 CR3: 000000000344c003 CR4: 0000000000f72ef0
<4> [337.878371] PKRU: 55555554
<4> [337.878373] Call Trace:
<4> [337.878374] <TASK>
<4> [337.878378] ? lock_sync+0x100/0x100
<4> [337.878382] ? lock_release+0xd0/0x2b0
<4> [337.878388] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [337.878394] process_one_work+0x239/0x760
<4> [337.878400] worker_thread+0x200/0x3f0
<4> [337.878403] ? __pfx_worker_thread+0x10/0x10
<4> [337.878406] kthread+0x10d/0x150
<4> [337.878409] ? __pfx_kthread+0x10/0x10
<4> [337.878413] ret_from_fork+0x3d4/0x480
<4> [337.878415] ? __pfx_kthread+0x10/0x10
<4> [337.878419] ret_from_fork_asm+0x1a/0x30
<4> [337.878426] </TASK>
<4> [337.878428] irq event stamp: 582811
<4> [337.878429] hardirqs last enabled at (582817): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [337.878432] hardirqs last disabled at (582822): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [337.878435] softirqs last enabled at (581948): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [337.878438] softirqs last disabled at (581937): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [337.878440] ---[ end trace 0000000000000000 ]---
<6> [337.878442] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [337.878514] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [337.878520] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [337.879773] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [337.879890] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [337.879997] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [337.880209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [337.880304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [337.880401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [337.880490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [337.880577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [337.880662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [337.880748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [337.880840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [337.880925] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [337.881020] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [337.881137] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [337.882162] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [337.892843] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [337.893095] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [337.894136] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [337.894215] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [337.894291] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [337.894368] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [337.894445] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [337.894520] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [337.894596] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [337.894670] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [337.894745] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [337.894821] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [337.894917] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [337.894996] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [337.895073] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [337.895151] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [337.895227] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [337.895305] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [337.895382] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [337.895458] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [337.895532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [337.895616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [337.895698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [337.895778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [337.895864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [337.895945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [337.896026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [337.896106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [337.896184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [337.896264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [337.896344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [337.896423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [337.896501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [337.896583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [337.896671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [337.896756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [337.896843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [337.896925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [337.897005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [337.897082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [337.897160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [337.897236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [337.897316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [337.897393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [337.897470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [337.897546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [337.897626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [337.897704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [337.897779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [337.897858] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [337.897939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [337.898019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [337.898097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [337.898177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [337.898256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [337.898338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [337.898417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [337.898496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [337.898572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [337.898649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [337.898728] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [337.898851] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [337.898856] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20880, lrc_seqno=20880, guc_id=0, flags=0x73 in no process [-1]
<7> [337.898858] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [337.898917] ------------[ cut here ]------------
<4> [337.898918] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [337.898919] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:44/2726
<4> [337.898990] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart coretemp spi_nor asus_nb_wmi mei_hdcp mei_pxp asus_wmi sparse_keymap mtd wmi_bmof platform_profile kvm_intel usbhid kvm irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core snd_hwdep intel_cstate r8169 snd_pcm video snd_timer realtek nls_iso8859_1 i2c_i801 idma64 snd i2c_mux mei_me spi_intel_pci i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_tad intel_vsec pinctrl_alderlake acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [337.899057] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [337.899062] CPU: 10 UID: 0 PID: 2726 Comm: kworker/u64:44 Tainted: G S U W L 7.0.0-lgci-xe-xe-4926-489e26ada57ce96a2-debug+ #1 PREEMPT(lazy)
<4> [337.899065] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [337.899066] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [337.899067] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [337.899072] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [337.899142] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 86 da 5e e1 48 89 c6 48 8d 3d ac 90 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [337.899144] RSP: 0018:ffffc9000542fca0 EFLAGS: 00010246
<4> [337.899146] RAX: ffffffffa1204833 RBX: 0000000000000000 RCX: 0000000000000000
<4> [337.899148] RDX: ffff888103cc5f10 RSI: ffffffffa1204833 RDI: ffffffffa1003f20
<4> [337.899149] RBP: ffffc9000542fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [337.899151] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [337.899152] R13: ffff888103cc5f10 R14: ffff888156db3818 R15: 00000000ffffffc2
<4> [337.899153] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [337.899155] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [337.899156] CR2: 00007cecb79a8360 CR3: 000000000344c005 CR4: 0000000000f72ef0
<4> [337.899158] PKRU: 55555554
<4> [337.899159] Call Trace:
<4> [337.899160] <TASK>
<4> [337.899164] ? lock_sync+0x100/0x100
<4> [337.899169] ? lock_release+0xd0/0x2b0
<4> [337.899174] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [337.899180] process_one_work+0x239/0x760
<4> [337.899186] worker_thread+0x200/0x3f0
<4> [337.899189] ? __pfx_worker_thread+0x10/0x10
<4> [337.899192] kthread+0x10d/0x150
<4> [337.899194] ? __pfx_kthread+0x10/0x10
<4> [337.899198] ret_from_fork+0x3d4/0x480
<4> [337.899200] ? __pfx_kthread+0x10/0x10
<4> [337.899204] ret_from_fork_asm+0x1a/0x30
<4> [337.899211] </TASK>
<4> [337.899212] irq event stamp: 706315
<4> [337.899213] hardirqs last enabled at (706321): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [337.899216] hardirqs last disabled at (706326): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [337.899219] softirqs last enabled at (705514): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [337.899221] softirqs last disabled at (705495): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [337.899223] ---[ end trace 0000000000000000 ]---
<7> [337.900553] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [337.900658] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [337.914022] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20889, lrc_seqno=20889, guc_id=0, flags=0x73 in no process [-1]
<7> [337.914026] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [337.914092] ------------[ cut here ]------------
<4> [337.914094] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [337.914095] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:8/712
<4> [337.914170] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart coretemp spi_nor asus_nb_wmi mei_hdcp mei_pxp asus_wmi sparse_keymap mtd wmi_bmof platform_profile kvm_intel usbhid kvm irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core snd_hwdep intel_cstate r8169 snd_pcm video snd_timer realtek nls_iso8859_1 i2c_i801 idma64 snd i2c_mux mei_me spi_intel_pci i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_tad intel_vsec pinctrl_alderlake acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [337.914236] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [337.914241] CPU: 10 UID: 0 PID: 712 Comm: kworker/u64:8 Tainted: G S U W L 7.0.0-lgci-xe-xe-4926-489e26ada57ce96a2-debug+ #1 PREEMPT(lazy)
<4> [337.914244] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [337.914245] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [337.914247] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [337.914252] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [337.914324] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 86 da 5e e1 48 89 c6 48 8d 3d ac 90 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [337.914326] RSP: 0018:ffffc90002b2fca0 EFLAGS: 00010246
<4> [337.914329] RAX: ffffffffa1204833 RBX: 0000000000000000 RCX: 0000000000000000
<4> [337.914330] RDX: ffff888103cc5f10 RSI: ffffffffa1204833 RDI: ffffffffa1003f20
<4> [337.914331] RBP: ffffc90002b2fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [337.914332] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [337.914334] R13: ffff888103cc5f10 R14: ffff888156db3818 R15: 00000000ffffffc2
<4> [337.914335] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [337.914337] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [337.914338] CR2: 00007cecb79a8360 CR3: 000000011d3f6004 CR4: 0000000000f72ef0
<4> [337.914340] PKRU: 55555554
<4> [337.914341] Call Trace:
<4> [337.914342] <TASK>
<4> [337.914346] ? lock_sync+0x100/0x100
<4> [337.914351] ? lock_release+0xd0/0x2b0
<4> [337.914356] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [337.914362] process_one_work+0x239/0x760
<4> [337.914369] worker_thread+0x200/0x3f0
<4> [337.914371] ? __pfx_worker_thread+0x10/0x10
<4> [337.914374] kthread+0x10d/0x150
<4> [337.914377] ? __pfx_kthread+0x10/0x10
<4> [337.914380] ret_from_fork+0x3d4/0x480
<4> [337.914382] ? __pfx_kthread+0x10/0x10
<4> [337.914386] ret_from_fork_asm+0x1a/0x30
<4> [337.914393] </TASK>
<4> [337.914394] irq event stamp: 1023185
<4> [337.914396] hardirqs last enabled at (1023191): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [337.914399] hardirqs last disabled at (1023196): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [337.914401] softirqs last enabled at (1022226): [<ffffffff8133ac13>] kernel_fpu_end+0x53/0x70
<4> [337.914403] softirqs last disabled at (1022224): [<ffffffff8133b324>] kernel_fpu_begin_mask+0xc4/0x120
<4> [337.914406] ---[ end trace 0000000000000000 ]---
<6> [337.914408] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [337.914479] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [337.914485] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [337.914939] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [337.915144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [337.915235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [337.915330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [337.915421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [337.915509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [337.915596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [337.915682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [337.915770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [337.915863] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [337.915962] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [337.916081] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [337.917104] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [337.926844] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [337.927095] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [337.928094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [337.928174] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [337.928251] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [337.928329] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [337.928406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [337.928483] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [337.928560] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [337.928637] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [337.928714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [337.928790] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [337.928873] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [337.928948] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [337.929022] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [337.929097] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [337.929171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [337.929247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [337.929320] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [337.929394] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [337.929468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [337.929549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [337.929633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [337.929716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [337.929797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [337.929886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [337.929967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [337.930046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [337.930124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [337.930205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [337.930285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [337.930364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [337.930442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [337.930520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [337.930604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [337.930688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [337.930775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [337.930865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [337.930948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [337.931027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [337.931108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [337.931191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [337.931274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [337.931354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [337.931433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [337.931510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [337.931591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [337.931670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [337.931748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [337.931824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [337.931915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [337.931992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [337.932068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [337.932148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [337.932225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [337.932302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [337.932377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [337.932455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [337.932531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [337.932612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [337.932695] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [337.932812] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [337.932816] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20889, lrc_seqno=20889, guc_id=0, flags=0x73 in no process [-1]
<7> [337.932818] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [337.932895] ------------[ cut here ]------------
<4> [337.932896] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [337.932898] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:8/712
<4> [337.932969] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart coretemp spi_nor asus_nb_wmi mei_hdcp mei_pxp asus_wmi sparse_keymap mtd wmi_bmof platform_profile kvm_intel usbhid kvm irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core snd_hwdep intel_cstate r8169 snd_pcm video snd_timer realtek nls_iso8859_1 i2c_i801 idma64 snd i2c_mux mei_me spi_intel_pci i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_tad intel_vsec pinctrl_alderlake acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [337.933035] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [337.933039] CPU: 10 UID: 0 PID: 712 Comm: kworker/u64:8 Tainted: G S U W L 7.0.0-lgci-xe-xe-4926-489e26ada57ce96a2-debug+ #1 PREEMPT(lazy)
<4> [337.933042] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [337.933043] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [337.933045] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [337.933050] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [337.933119] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 86 da 5e e1 48 89 c6 48 8d 3d ac 90 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [337.933121] RSP: 0018:ffffc90002b2fca0 EFLAGS: 00010246
<4> [337.933123] RAX: ffffffffa1204833 RBX: 0000000000000000 RCX: 0000000000000000
<4> [337.933124] RDX: ffff888103cc5f10 RSI: ffffffffa1204833 RDI: ffffffffa1003f20
<4> [337.933126] RBP: ffffc90002b2fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [337.933127] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [337.933128] R13: ffff888103cc5f10 R14: ffff888156db3818 R15: 00000000ffffffc2
<4> [337.933129] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [337.933131] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [337.933132] CR2: 00007cecb79a8360 CR3: 000000011d3f6004 CR4: 0000000000f72ef0
<4> [337.933134] PKRU: 55555554
<4> [337.933135] Call Trace:
<4> [337.933136] <TASK>
<4> [337.933140] ? lock_sync+0x100/0x100
<4> [337.933145] ? lock_release+0xd0/0x2b0
<4> [337.933150] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [337.933156] process_one_work+0x239/0x760
<4> [337.933162] worker_thread+0x200/0x3f0
<4> [337.933165] ? __pfx_worker_thread+0x10/0x10
<4> [337.933168] kthread+0x10d/0x150
<4> [337.933171] ? __pfx_kthread+0x10/0x10
<4> [337.933174] ret_from_fork+0x3d4/0x480
<4> [337.933176] ? __pfx_kthread+0x10/0x10
<4> [337.933180] ret_from_fork_asm+0x1a/0x30
<4> [337.933187] </TASK>
<4> [337.933188] irq event stamp: 1026317
<4> [337.933189] hardirqs last enabled at (1026323): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [337.933192] hardirqs last disabled at (1026328): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [337.933194] softirqs last enabled at (1025300): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [337.933197] softirqs last disabled at (1025293): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [337.933199] ---[ end trace 0000000000000000 ]---
<6> [337.933201] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [337.933271] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [337.933278] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [337.934512] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [337.934620] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [337.934726] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [337.934940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [337.935033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [337.935128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [337.935217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [337.935306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [337.935393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [337.935481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [337.935570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [337.935658] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [337.935757] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [337.935884] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [337.936898] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [337.946841] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [337.947093] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [337.948120] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [337.948203] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [337.948281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [337.948360] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [337.948437] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [337.948513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [337.948588] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [337.948664] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [337.948739] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [337.948814] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [337.948917] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [337.949054] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [337.949181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [337.949306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [337.949429] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [337.949552] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [337.949673] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [337.949795] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [337.949931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [337.950061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [337.950189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [337.950314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [337.950441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [337.950572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [337.950697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [337.950821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [337.950969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [337.951098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [337.951226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [337.951352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [337.951479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [337.951606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [337.951739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [337.951877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [337.952010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [337.952139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [337.952268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [337.952394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [337.952519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [337.952643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [337.952771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [337.952902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [337.953028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [337.953152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [337.953281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [337.953406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [337.953531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [337.953656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [337.953781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [337.953917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [337.954003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [337.954089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [337.954170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [337.954249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [337.954327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [337.954405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [337.954482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [337.954559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [337.954639] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [337.954756] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [337.954760] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20889, lrc_seqno=20889, guc_id=0, flags=0x73 in no process [-1]
<7> [337.954762] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [337.954821] ------------[ cut here ]------------
<4> [337.954823] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [337.954824] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:19/2700
<4> [337.954910] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart coretemp spi_nor asus_nb_wmi mei_hdcp mei_pxp asus_wmi sparse_keymap mtd wmi_bmof platform_profile kvm_intel usbhid kvm irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core snd_hwdep intel_cstate r8169 snd_pcm video snd_timer realtek nls_iso8859_1 i2c_i801 idma64 snd i2c_mux mei_me spi_intel_pci i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_tad intel_vsec pinctrl_alderlake acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [337.954975] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [337.954980] CPU: 10 UID: 0 PID: 2700 Comm: kworker/u64:19 Tainted: G S U W L 7.0.0-lgci-xe-xe-4926-489e26ada57ce96a2-debug+ #1 PREEMPT(lazy)
<4> [337.954983] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [337.954984] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [337.954985] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [337.954990] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [337.955060] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 86 da 5e e1 48 89 c6 48 8d 3d ac 90 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [337.955062] RSP: 0018:ffffc90004a17ca0 EFLAGS: 00010246
<4> [337.955064] RAX: ffffffffa1204833 RBX: 0000000000000000 RCX: 0000000000000000
<4> [337.955065] RDX: ffff888103cc5f10 RSI: ffffffffa1204833 RDI: ffffffffa1003f20
<4> [337.955067] RBP: ffffc90004a17db0 R08: 0000000000000000 R09: 0000000000000000
<4> [337.955068] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [337.955069] R13: ffff888103cc5f10 R14: ffff888156db3818 R15: 00000000ffffffc2
<4> [337.955070] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [337.955072] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [337.955073] CR2: 00007cecb79a8360 CR3: 000000011d3f6004 CR4: 0000000000f72ef0
<4> [337.955075] PKRU: 55555554
<4> [337.955076] Call Trace:
<4> [337.955077] <TASK>
<4> [337.955081] ? lock_sync+0x100/0x100
<4> [337.955085] ? lock_release+0xd0/0x2b0
<4> [337.955090] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [337.955096] process_one_work+0x239/0x760
<4> [337.955102] worker_thread+0x200/0x3f0
<4> [337.955105] ? __pfx_worker_thread+0x10/0x10
<4> [337.955108] kthread+0x10d/0x150
<4> [337.955110] ? __pfx_kthread+0x10/0x10
<4> [337.955114] ret_from_fork+0x3d4/0x480
<4> [337.955116] ? __pfx_kthread+0x10/0x10
<4> [337.955119] ret_from_fork_asm+0x1a/0x30
<4> [337.955127] </TASK>
<4> [337.955128] irq event stamp: 586307
<4> [337.955129] hardirqs last enabled at (586313): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [337.955132] hardirqs last disabled at (586318): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [337.955134] softirqs last enabled at (585558): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [337.955137] softirqs last disabled at (585553): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [337.955139] ---[ end trace 0000000000000000 ]---
<7> [337.956424] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [337.956540] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [337.957541] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20890, lrc_seqno=20890, guc_id=0, flags=0x73 in no process [-1]
<7> [337.957544] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [337.957624] ------------[ cut here ]------------
<4> [337.957625] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [337.957626] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:19/2700
<4> [337.957697] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr
<7> [337.957713] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:561]
<4> [337.957717] intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart coretemp spi_nor asus_nb_wmi mei_hdcp mei_pxp asus_wmi sparse_keymap mtd wmi_bmof platform_profile kvm_intel usbhid kvm irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core snd_hwdep intel_cstate r8169 snd_pcm video snd_timer realtek nls_iso8859_1 i2c_i801 idma64 snd i2c_mux mei_me spi_intel_pci i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_tad intel_vsec pinctrl_alderlake acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [337.957769] CPU: 0 UID: 0 PID: 2700 Comm: kworker/u64:19 Tainted: G S U W L 7.0.0-lgci-xe-xe-4926-489e26ada57ce96a2-debug+ #1 PREEMPT(lazy)
<4> [337.957772] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [337.957773] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [337.957774] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [337.957780] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [337.957866] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 86 da 5e e1 48 89 c6 48 8d 3d ac 90 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [337.957868] RSP: 0018:ffffc90004a17ca0 EFLAGS: 00010246
<4> [337.957870] RAX: ffffffffa1204833 RBX: 0000000000000000 RCX: 0000000000000000
<4> [337.957872] RDX: ffff888103cc5f10 RSI: ffffffffa1204833 RDI: ffffffffa1003f20
<4> [337.957873] RBP: ffffc90004a17db0 R08: 0000000000000000 R09: 0000000000000000
<4> [337.957874] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [337.957876] R13: ffff888103cc5f10 R14: ffff888156db3818 R15: 00000000ffffffc2
<4> [337.957877] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000
<4> [337.957879] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [337.957880] CR2: 00007b8c3887a000 CR3: 0000000121e12001 CR4: 0000000000f72ef0
<4> [337.957881] PKRU: 55555554
<4> [337.957883] Call Trace:
<4> [337.957884] <TASK>
<4> [337.957888] ? lock_sync+0x100/0x100
<4> [337.957892] ? lock_release+0xd0/0x2b0
<4> [337.957898] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [337.957904] process_one_work+0x239/0x760
<4> [337.957910] worker_thread+0x200/0x3f0
<4> [337.957913] ? __pfx_worker_thread+0x10/0x10
<4> [337.957922] kthread+0x10d/0x150
<4> [337.957925] ? __pfx_kthread+0x10/0x10
<4> [337.957929] ret_from_fork+0x3d4/0x480
<4> [337.957931] ? __pfx_kthread+0x10/0x10
<4> [337.957934] ret_from_fork_asm+0x1a/0x30
<4> [337.957942] </TASK>
<4> [337.957943] irq event stamp: 587497
<4> [337.957944] hardirqs last enabled at (587503): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [337.957947] hardirqs last disabled at (587508): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [337.957950] softirqs last enabled at (587334): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [337.957952] softirqs last disabled at (587319): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [337.957955] ---[ end trace 0000000000000000 ]---
<6> [337.957956] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [337.958027] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [337.958035] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [337.958211] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [337.958486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [337.958617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [337.958753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [337.958921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [337.959055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [337.959186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [337.959319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [337.959455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [337.959586] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [337.959727] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [337.959905] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [337.960921] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [337.970839] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [337.971092] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [337.972112] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [337.972208] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [337.972294] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [337.972379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [337.972462] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [337.972542] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [337.972622] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [337.972702] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [337.972781] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [337.972876] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [337.972955] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [337.973034] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [337.973114] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [337.973193] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [337.973272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [337.973352] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [337.973432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [337.973515] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [337.973597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [337.973686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [337.973773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [337.973865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [337.973950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [337.974034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [337.974116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [337.974198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [337.974281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [337.974369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [337.974457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [337.974543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [337.974629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [337.974714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [337.974804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [337.974901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [337.974990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [337.975076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [337.975161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [337.975244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [337.975331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [337.975416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [337.975503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [337.975588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [337.975671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [337.975752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [337.975842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [337.975924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [337.976008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [337.976094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [337.976180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [337.976261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [337.976343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [337.976428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [337.976513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [337.976599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [337.976683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [337.976766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [337.976850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [337.976931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [337.977016] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [337.977134] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [337.977138] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20890, lrc_seqno=20890, guc_id=0, flags=0x73 in no process [-1]
<7> [337.977141] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [337.977203] ------------[ cut here ]------------
<4> [337.977204] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [337.977206] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:44/2726
<4> [337.977281] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart coretemp spi_nor asus_nb_wmi mei_hdcp mei_pxp asus_wmi sparse_keymap mtd wmi_bmof platform_profile kvm_intel usbhid kvm irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core snd_hwdep intel_cstate r8169 snd_pcm video snd_timer realtek nls_iso8859_1 i2c_i801 idma64 snd i2c_mux mei_me spi_intel_pci i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_tad intel_vsec pinctrl_alderlake acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [337.977347] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [337.977352] CPU: 6 UID: 0 PID: 2726 Comm: kworker/u64:44 Tainted: G S U W L 7.0.0-lgci-xe-xe-4926-489e26ada57ce96a2-debug+ #1 PREEMPT(lazy)
<4> [337.977355] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [337.977356] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [337.977358] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [337.977363] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [337.977438] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 86 da 5e e1 48 89 c6 48 8d 3d ac 90 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [337.977440] RSP: 0000:ffffc9000542fca0 EFLAGS: 00010246
<4> [337.977442] RAX: ffffffffa1204833 RBX: 0000000000000000 RCX: 0000000000000000
<4> [337.977444] RDX: ffff888103cc5f10 RSI: ffffffffa1204833 RDI: ffffffffa1003f20
<4> [337.977445] RBP: ffffc9000542fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [337.977446] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [337.977447] R13: ffff888103cc5f10 R14: ffff888156db3818 R15: 00000000ffffffc2
<4> [337.977449] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [337.977451] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [337.977452] CR2: 00007b8c38891000 CR3: 00000005e0d6b003 CR4: 0000000000f72ef0
<4> [337.977453] PKRU: 55555554
<4> [337.977455] Call Trace:
<4> [337.977456] <TASK>
<4> [337.977459] ? lock_sync+0x100/0x100
<4> [337.977464] ? lock_release+0xd0/0x2b0
<4> [337.977470] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [337.977476] process_one_work+0x239/0x760
<4> [337.977482] worker_thread+0x200/0x3f0
<4> [337.977485] ? __pfx_worker_thread+0x10/0x10
<4> [337.977487] kthread+0x10d/0x150
<4> [337.977490] ? __pfx_kthread+0x10/0x10
<4> [337.977494] ret_from_fork+0x3d4/0x480
<4> [337.977496] ? __pfx_kthread+0x10/0x10
<4> [337.977500] ret_from_fork_asm+0x1a/0x30
<4> [337.977507] </TASK>
<4> [337.977508] irq event stamp: 709977
<4> [337.977510] hardirqs last enabled at (709983): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [337.977512] hardirqs last disabled at (709988): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [337.977515] softirqs last enabled at (709026): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [337.977517] softirqs last disabled at (709019): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [337.977520] ---[ end trace 0000000000000000 ]---
<6> [337.977522] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [337.977597] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [337.977603] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [337.978020] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [337.978228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [337.978320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [337.978418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [337.978511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [337.978600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [337.978690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [337.978781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [337.978882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [337.978968] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [337.979070] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [337.979194] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [337.980206] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [337.990933] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [337.991188] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [337.992404] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [337.992491] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [337.992572] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [337.992655] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [337.992736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [337.992820] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [337.992918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [337.993000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [337.993080] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [337.993160] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [337.993240] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [337.993319] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [337.993399] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [337.993478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [337.993557] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [337.993636] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [337.993715] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [337.993794] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [337.993881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [337.993968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [337.994056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [337.994141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [337.994231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [337.994318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [337.994403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [337.994486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [337.994569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [337.994653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [337.994739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [337.994823] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [337.994920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [337.995004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [337.995094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [337.995182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [337.995271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [337.995357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [337.995443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [337.995524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [337.995606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [337.995687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [337.995771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [337.995859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [337.995941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [337.996025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [337.996114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [337.996199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [337.996284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [337.996366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [337.996450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [337.996531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [337.996612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [337.996696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [337.996777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [337.996864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [337.996947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [337.997034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [337.997120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [337.997203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [337.997288] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [337.997403] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [337.997407] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20890, lrc_seqno=20890, guc_id=0, flags=0x73 in no process [-1]
<7> [337.997410] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [337.997471] ------------[ cut here ]------------
<4> [337.997472] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [337.997473] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:44/2726
<4> [337.997550] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart coretemp spi_nor asus_nb_wmi mei_hdcp mei_pxp asus_wmi sparse_keymap mtd wmi_bmof platform_profile kvm_intel usbhid kvm irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core snd_hwdep intel_cstate r8169 snd_pcm video snd_timer realtek nls_iso8859_1 i2c_i801 idma64 snd i2c_mux mei_me spi_intel_pci i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_tad intel_vsec pinctrl_alderlake acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [337.997614] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [337.997618] CPU: 6 UID: 0 PID: 2726 Comm: kworker/u64:44 Tainted: G S U W L 7.0.0-lgci-xe-xe-4926-489e26ada57ce96a2-debug+ #1 PREEMPT(lazy)
<4> [337.997621] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [337.997622] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [337.997624] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [337.997629] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [337.997703] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 86 da 5e e1 48 89 c6 48 8d 3d ac 90 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [337.997705] RSP: 0000:ffffc9000542fca0 EFLAGS: 00010246
<4> [337.997707] RAX: ffffffffa1204833 RBX: 0000000000000000 RCX: 0000000000000000
<4> [337.997709] RDX: ffff888103cc5f10 RSI: ffffffffa1204833 RDI: ffffffffa1003f20
<4> [337.997710] RBP: ffffc9000542fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [337.997711] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [337.997712] R13: ffff888103cc5f10 R14: ffff888156db3818 R15: 00000000ffffffc2
<4> [337.997714] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [337.997715] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [337.997717] CR2: 00007b8c38891000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [337.997718] PKRU: 55555554
<4> [337.997719] Call Trace:
<4> [337.997720] <TASK>
<4> [337.997724] ? lock_sync+0x100/0x100
<4> [337.997728] ? lock_release+0xd0/0x2b0
<4> [337.997734] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [337.997740] process_one_work+0x239/0x760
<4> [337.997746] worker_thread+0x200/0x3f0
<4> [337.997749] ? __pfx_worker_thread+0x10/0x10
<4> [337.997751] kthread+0x10d/0x150
<4> [337.997754] ? __pfx_kthread+0x10/0x10
<4> [337.997758] ret_from_fork+0x3d4/0x480
<4> [337.997760] ? __pfx_kthread+0x10/0x10
<4> [337.997763] ret_from_fork_asm+0x1a/0x30
<4> [337.997770] </TASK>
<4> [337.997772] irq event stamp: 713135
<4> [337.997773] hardirqs last enabled at (713141): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [337.997776] hardirqs last disabled at (713146): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [337.997778] softirqs last enabled at (712164): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [337.997781] softirqs last disabled at (712157): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [337.997783] ---[ end trace 0000000000000000 ]---
<7> [337.999074] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [337.999184] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [338.014605] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20905, lrc_seqno=20905, guc_id=0, flags=0x73 in no process [-1]
<7> [338.014608] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [338.014670] ------------[ cut here ]------------
<4> [338.014671] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [338.014673] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:44/2726
<4> [338.014741] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart coretemp spi_nor asus_nb_wmi mei_hdcp mei_pxp asus_wmi sparse_keymap mtd wmi_bmof platform_profile kvm_intel usbhid kvm irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core snd_hwdep intel_cstate r8169 snd_pcm video snd_timer realtek nls_iso8859_1 i2c_i801 idma64 snd i2c_mux mei_me spi_intel_pci i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_tad intel_vsec pinctrl_alderlake acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [338.014801] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [338.014805] CPU: 0 UID: 0 PID: 2726 Comm: kworker/u64:44 Tainted: G S U W L 7.0.0-lgci-xe-xe-4926-489e26ada57ce96a2-debug+ #1 PREEMPT(lazy)
<4> [338.014808] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [338.014809] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [338.014810] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [338.014815] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [338.014906] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 86 da 5e e1 48 89 c6 48 8d 3d ac 90 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [338.014909] RSP: 0018:ffffc9000542fca0 EFLAGS: 00010246
<4> [338.014913] RAX: ffffffffa1204833 RBX: 0000000000000000 RCX: 0000000000000000
<4> [338.014915] RDX: ffff888103cc5f10 RSI: ffffffffa1204833 RDI: ffffffffa1003f20
<4> [338.014916] RBP: ffffc9000542fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [338.014918] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [338.014919] R13: ffff888103cc5f10 R14: ffff888156db3818 R15: 00000000ffffffc2
<4> [338.014921] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000
<4> [338.014923] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [338.014924] CR2: 00007b8c3887a000 CR3: 000000000344c003 CR4: 0000000000f72ef0
<4> [338.014926] PKRU: 55555554
<4> [338.014927] Call Trace:
<4> [338.014928] <TASK>
<4> [338.014932] ? lock_sync+0x100/0x100
<4> [338.014937] ? lock_release+0xd0/0x2b0
<4> [338.014942] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [338.014949] process_one_work+0x239/0x760
<4> [338.014955] worker_thread+0x200/0x3f0
<4> [338.014959] ? __pfx_worker_thread+0x10/0x10
<4> [338.014961] kthread+0x10d/0x150
<4> [338.014965] ? __pfx_kthread+0x10/0x10
<4> [338.014968] ret_from_fork+0x3d4/0x480
<4> [338.014971] ? __pfx_kthread+0x10/0x10
<4> [338.014974] ret_from_fork_asm+0x1a/0x30
<4> [338.014982] </TASK>
<4> [338.014983] irq event stamp: 714743
<4> [338.014985] hardirqs last enabled at (714749): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [338.014988] hardirqs last disabled at (714754): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [338.014991] softirqs last enabled at (714582): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [338.014994] softirqs last disabled at (714571): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [338.014996] ---[ end trace 0000000000000000 ]---
<6> [338.014998] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [338.015068] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [338.015074] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [338.015244] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [338.015446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [338.015536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [338.015631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [338.015719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [338.015805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [338.015901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [338.015987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [338.016073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [338.016155] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [338.016251] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [338.016368] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [338.017377] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [338.027835] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [338.028087] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [338.029266] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [338.029346] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [338.029424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [338.029501] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [338.029578] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [338.029654] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [338.029730] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [338.029805] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [338.029896] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [338.029974] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [338.030051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [338.030127] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [338.030203] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [338.030277] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [338.030352] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [338.030424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [338.030497] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [338.030571] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [338.030643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [338.030724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [338.030805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [338.030896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [338.030977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [338.031055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [338.031133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [338.031209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [338.031289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [338.031371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [338.031453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [338.031531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [338.031611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [338.031689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [338.031772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [338.031864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [338.031948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [338.032029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [338.032107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [338.032185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [338.032266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [338.032347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [338.032430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [338.032511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [338.032589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [338.032666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [338.032746] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [338.032824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [338.032925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [338.033002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [338.033080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [338.033155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [338.033231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [338.033309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [338.033386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [338.033463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [338.033539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [338.033620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [338.033701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [338.033780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [338.033875] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [338.033994] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [338.033998] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20905, lrc_seqno=20905, guc_id=0, flags=0x73 in no process [-1]
<7> [338.034001] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [338.034059] ------------[ cut here ]------------
<4> [338.034060] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [338.034061] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:44/2726
<4> [338.034133] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart coretemp spi_nor asus_nb_wmi mei_hdcp mei_pxp asus_wmi sparse_keymap mtd wmi_bmof platform_profile kvm_intel usbhid kvm irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core snd_hwdep intel_cstate r8169 snd_pcm video snd_timer realtek nls_iso8859_1 i2c_i801 idma64 snd i2c_mux mei_me spi_intel_pci i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_tad intel_vsec pinctrl_alderlake acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [338.034198] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [338.034202] CPU: 0 UID: 0 PID: 2726 Comm: kworker/u64:44 Tainted: G S U W L 7.0.0-lgci-xe-xe-4926-489e26ada57ce96a2-debug+ #1 PREEMPT(lazy)
<4> [338.034205] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [338.034206] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [338.034208] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [338.034213] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [338.034283] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 86 da 5e e1 48 89 c6 48 8d 3d ac 90 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [338.034285] RSP: 0018:ffffc9000542fca0 EFLAGS: 00010246
<4> [338.034287] RAX: ffffffffa1204833 RBX: 0000000000000000 RCX: 0000000000000000
<4> [338.034288] RDX: ffff888103cc5f10 RSI: ffffffffa1204833 RDI: ffffffffa1003f20
<4> [338.034290] RBP: ffffc9000542fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [338.034291] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [338.034292] R13: ffff888103cc5f10 R14: ffff888156db3818 R15: 00000000ffffffc2
<4> [338.034293] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000
<4> [338.034295] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [338.034296] CR2: 00007b8c3887a000 CR3: 000000000344c003 CR4: 0000000000f72ef0
<4> [338.034298] PKRU: 55555554
<4> [338.034299] Call Trace:
<4> [338.034300] <TASK>
<4> [338.034304] ? lock_sync+0x100/0x100
<4> [338.034309] ? lock_release+0xd0/0x2b0
<4> [338.034314] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [338.034320] process_one_work+0x239/0x760
<4> [338.034326] worker_thread+0x200/0x3f0
<4> [338.034329] ? __pfx_worker_thread+0x10/0x10
<4> [338.034331] kthread+0x10d/0x150
<4> [338.034334] ? __pfx_kthread+0x10/0x10
<4> [338.034338] ret_from_fork+0x3d4/0x480
<4> [338.034340] ? __pfx_kthread+0x10/0x10
<4> [338.034343] ret_from_fork_asm+0x1a/0x30
<4> [338.034351] </TASK>
<4> [338.034352] irq event stamp: 717873
<4> [338.034353] hardirqs last enabled at (717879): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [338.034356] hardirqs last disabled at (717884): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [338.034358] softirqs last enabled at (717016): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [338.034361] softirqs last disabled at (717009): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [338.034363] ---[ end trace 0000000000000000 ]---
<6> [338.034381] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [338.034452] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [338.034458] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [338.035697] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [338.035804] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [338.035918] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [338.036129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [338.036224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [338.036319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [338.036408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [338.036496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [338.036585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [338.036674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [338.036765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [338.036856] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [338.036953] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [338.037070] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [338.038080] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [338.047835] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [338.048087] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [338.049114] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [338.049192] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [338.049270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [338.049348] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [338.049428] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [338.049507] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [338.049583] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [338.049660] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [338.049734] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [338.049810] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [338.049896] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [338.049971] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [338.050046] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [338.050121] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [338.050198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [338.050277] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [338.050353] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [338.050428] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [338.050504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [338.050586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [338.050670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [338.050752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [338.050837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [338.050916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [338.050995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [338.051072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [338.051150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [338.051231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [338.051314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [338.051397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [338.051480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [338.051560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [338.051647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [338.051733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [338.051821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [338.051922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [338.052006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [338.052087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [338.052167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [338.052245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [338.052325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [338.052404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [338.052482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [338.052559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [338.052640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [338.052718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [338.052798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [338.052891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [338.052973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [338.053052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [338.053131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [338.053213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [338.053292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [338.053370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [338.053447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [338.053527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [338.053607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [338.053687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [338.053771] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [338.053892] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [338.053897] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=20905, lrc_seqno=20905, guc_id=0, flags=0x73 in no process [-1]
<7> [338.053899] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [338.053960] ------------[ cut here ]------------
<4> [338.053961] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [338.053962] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:2/120
<4> [338.054034] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal binfmt_misc intel_powerclamp hid_generic cmdlinepart coretemp spi_nor asus_nb_wmi mei_hdcp mei_pxp asus_wmi sparse_keymap mtd wmi_bmof platform_profile kvm_intel usbhid kvm irqbypass hid ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec rapl snd_hda_core snd_hwdep intel_cstate r8169 snd_pcm video snd_timer realtek nls_iso8859_1 i2c_i801 idma64 snd i2c_mux mei_me spi_intel_pci i2c_smbus soundcore spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry wmi acpi_tad intel_vsec pinctrl_alderlake acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [338.054099] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [338.054104] CPU: 4 UID: 0 PID: 120 Comm: kworker/u64:2 Tainted: G S U W L 7.0.0-lgci-xe-xe-4926-489e26ada57ce96a2-debug+ #1 PREEMPT(lazy)
<4> [338.054107] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP
<4> [338.054108] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [338.054109] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [338.054115] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [338.054186] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 86 da 5e e1 48 89 c6 48 8d 3d ac 90 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [338.054188] RSP: 0018:ffffc9000055bca0 EFLAGS: 00010246
<4> [338.054190] RAX: ffffffffa1204833 RBX: 0000000000000000 RCX: 0000000000000000
<4> [338.054192] RDX: ffff888103cc5f10 RSI: ffffffffa1204833 RDI: ffffffffa1003f20
<4> [338.054193] RBP: ffffc9000055bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [338.054194] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [338.054195] R13: ffff888103cc5f10 R14: ffff888156db3818 R15: 00000000ffffffc2
<4> [338.054197] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000
<4> [338.054198] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [338.054200] CR2: 00007bea440361a0 CR3: 000000010e03c001 CR4: 0000000000f72ef0
<4> [338.054201] PKRU: 55555554
<4> [338.054202] Call Trace:
<4> [338.054203] <TASK>
<4> [338.054207] ? lock_sync+0x100/0x100
<4> [338.054212] ? lock_release+0xd0/0x2b0
<4> [338.054217] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [338.054223] process_one_work+0x239/0x760
<4> [338.054230] worker_thread+0x200/0x3f0
<4> [338.054233] ? __pfx_worker_thread+0x10/0x10
<4> [338.054235] kthread+0x10d/0x150
<4> [338.054238] ? __pfx_kthread+0x10/0x10
<4> [338.054242] ret_from_fork+0x3d4/0x480
<4> [338.054244] ? __pfx_kthread+0x10/0x10
<4> [338.054247] ret_from_fork_asm+0x1a/0x30
<4> [338.054254] </TASK>
<4> [338.054256] irq event stamp: 560607
<4> [338.054257] hardirqs last enabled at (560613): [<ffffffff814aadd9>] __up_console_sem+0x79/0xa0
<4> [338.054260] hardirqs last disabled at (560618): [<ffffffff814aadbe>] __up_console_sem+0x5e/0xa0
<4> [338.054262] softirqs last enabled at (559758): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [338.054264] softirqs last disabled at (559753): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [338.054267] ---[ end trace 0000000000000000 ]---
<7> [338.055310] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [338.055416] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [338.084770] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:389:plane 1D] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm
<7> [338.085010] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:389:plane 1D] lines 1, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 4, 4, 9, 9, 17, 17, 17, 17, 0, 15, 0
<7> [338.085206] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:389:plane 1D] blocks 16, 49, 145, 145, 273, 273, 273, 273, 30, 241, 255 -> 62, 62, 139, 139, 261, 261, 261, 261, 137, 230, 244
<7> [338.085389] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:389:plane 1D] min_ddb 19, 55, 161, 161, 302, 302, 0, 0, 31, 267, 267 -> 123, 123, 245, 245, 367, 367, 0, 0, 138, 306, 306
<7> [338.102282] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:389:plane 1D] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm
<7> [338.102685] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:389:plane 1D] lines 4, 4, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 1, 3, 9, 9, 17, 17, 17, 17, 0, 15, 0
<7> [338.103134] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:389:plane 1D] blocks 62, 62, 139, 139, 261, 261, 261, 261, 137, 230, 244 -> 16, 49, 145, 145, 273, 273, 273, 273, 30, 241, 255
<7> [338.103552] xe 0000:03:00.0: [drm:skl_print_plane_wm_changes [xe]] [PLANE:389:plane 1D] min_ddb 123, 123, 245, 245, 367, 367, 0, 0, 138, 306, 306 -> 19, 55, 161, 161, 302, 302, 0, 0, 31, 267, 267
<6> [338.136193] [IGT] kms_flip_tiling: finished subtest pipe-D-HDMI-A-3-4-rc-ccs-to-linear, SUCCESS
|