Results for igt@kms_async_flips@async-flip-with-page-flip-events-tiled@pipe-c-dp-2-4-rc-ccs

Result: Dmesg-Warn 192 Warning(s)

i915_display_info20 igt_runner20 results20.json results20-xe-load.json guc_logs20.tar i915_display_info_post_exec20 boot20 dmesg20

DetailValue
Duration 2.81 seconds
Hostname
shard-bmg-8
Igt-Version
IGT-Version: 2.3-g0918a5c2c (x86_64) (Linux: 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ x86_64)
Out
Starting dynamic subtest: pipe-C-DP-2-4-rc-ccs
Dynamic subtest pipe-C-DP-2-4-rc-ccs: SUCCESS (2.809s)
Err
Starting dynamic subtest: pipe-C-DP-2-4-rc-ccs
Dynamic subtest pipe-C-DP-2-4-rc-ccs: SUCCESS (2.809s)
Dmesg

<6> [330.868863] [IGT] kms_async_flips: starting dynamic subtest pipe-C-DP-2-4-rc-ccs
<7> [330.869459] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:557]
<5> [330.869730] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16429, lrc_seqno=16429, guc_id=0, flags=0x73 in no process [-1]
<7> [330.869735] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [330.869794] ------------[ cut here ]------------
<4> [330.869795] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [330.869799] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:9/208
<4> [330.869868] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [330.869928] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [330.869936] CPU: 6 UID: 0 PID: 208 Comm: kworker/u64:9 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [330.869939] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [330.869940] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [330.869942] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [330.869947] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [330.870027] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [330.870028] RSP: 0018:ffffc9000163fca0 EFLAGS: 00010246
<4> [330.870031] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [330.870032] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [330.870033] RBP: ffffc9000163fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [330.870034] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [330.870035] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [330.870036] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000
<4> [330.870037] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [330.870038] CR2: 000072601fe8a000 CR3: 000000000344a005 CR4: 0000000000f72ef0
<4> [330.870040] PKRU: 55555554
<4> [330.870041] Call Trace:
<4> [330.870042] <TASK>
<4> [330.870045] ? __pfx_lock_acquire+0x10/0x10
<4> [330.870051] ? lock_release+0xd0/0x2b0
<4> [330.870055] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [330.870060] process_one_work+0x22e/0x740
<4> [330.870067] worker_thread+0x1e8/0x3d0
<4> [330.870070] ? __pfx_worker_thread+0x10/0x10
<4> [330.870073] kthread+0x10d/0x150
<4> [330.870076] ? __pfx_kthread+0x10/0x10
<4> [330.870079] ret_from_fork+0x3d4/0x480
<4> [330.870082] ? __pfx_kthread+0x10/0x10
<4> [330.870085] ret_from_fork_asm+0x1a/0x30
<4> [330.870091] </TASK>
<4> [330.870092] irq event stamp: 1661567
<4> [330.870093] hardirqs last enabled at (1661573): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [330.870096] hardirqs last disabled at (1661578): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [330.870098] softirqs last enabled at (1645720): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [330.870100] softirqs last disabled at (1645713): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [330.870102] ---[ end trace 0000000000000000 ]---
<6> [330.870104] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [330.870168] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [330.870211] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [330.870604] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [330.870888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [330.871022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [330.871157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [330.871285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [330.871484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [330.871612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [330.871740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [330.871866] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [330.872003] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [330.872163] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [330.873564] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [330.884383] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [330.884715] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [330.885469] xe 0000:03:00.0: [drm:intel_power_well_disable [xe]] disabling DC_off
<7> [330.885591] xe 0000:03:00.0: [drm:skl_enable_dc6 [xe]] Enabling DC6
<7> [330.885684] xe 0000:03:00.0: [drm:gen9_set_dc_state.part.0 [xe]] Setting DC state from 00 to 02
<7> [330.885791] xe 0000:03:00.0: [drm:intel_power_well_disable [xe]] disabling always-on
<7> [330.886105] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [330.886229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [330.886349] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [330.886486] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [330.886618] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [330.886754] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [330.886897] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [330.887031] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [330.887163] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [330.887294] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [330.887436] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [330.887573] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [330.887715] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [330.887859] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [330.888006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [330.888153] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [330.888300] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [330.888452] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [330.888604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [330.888766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [330.888927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [330.889084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [330.889248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [330.889418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [330.889582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [330.889751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [330.889921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [330.890097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [330.890273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [330.890461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [330.890649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [330.890839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [330.891036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [330.891233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [330.891442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [330.891647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [330.891850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [330.892049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [330.892242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [330.892434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [330.892627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [330.892809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [330.892990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [330.893169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [330.893350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [330.893524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [330.893691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [330.893855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [330.894021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [330.894184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [330.894338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [330.894499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [330.894652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [330.894801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [330.894946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [330.895094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [330.895237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [330.895376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [330.895520] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [330.895708] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [330.895716] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16429, lrc_seqno=16429, guc_id=0, flags=0x73 in no process [-1]
<7> [330.895720] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [330.895832] ------------[ cut here ]------------
<4> [330.895833] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [330.895835] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#13: kworker/u64:16/3882
<4> [330.895955] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [330.896050] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [330.896062] CPU: 13 UID: 0 PID: 3882 Comm: kworker/u64:16 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [330.896066] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [330.896068] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [330.896070] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [330.896078] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [330.896192] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [330.896195] RSP: 0018:ffffc90003ea7ca0 EFLAGS: 00010246
<4> [330.896198] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [330.896200] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [330.896202] RBP: ffffc90003ea7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [330.896203] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [330.896205] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [330.896207] FS: 0000000000000000(0000) GS:ffff8888db31b000(0000) knlGS:0000000000000000
<4> [330.896209] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [330.896211] CR2: 00007a4adf3ab000 CR3: 000000000344a002 CR4: 0000000000f72ef0
<4> [330.896213] PKRU: 55555554
<4> [330.896215] Call Trace:
<4> [330.896216] <TASK>
<4> [330.896223] ? __pfx_lock_acquire+0x10/0x10
<4> [330.896232] ? lock_release+0xd0/0x2b0
<4> [330.896241] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [330.896251] process_one_work+0x22e/0x740
<4> [330.896263] worker_thread+0x1e8/0x3d0
<4> [330.896268] ? __pfx_worker_thread+0x10/0x10
<4> [330.896272] kthread+0x10d/0x150
<4> [330.896276] ? __pfx_kthread+0x10/0x10
<4> [330.896281] ret_from_fork+0x3d4/0x480
<4> [330.896285] ? __pfx_kthread+0x10/0x10
<4> [330.896290] ret_from_fork_asm+0x1a/0x30
<4> [330.896303] </TASK>
<4> [330.896304] irq event stamp: 772579
<4> [330.896306] hardirqs last enabled at (772585): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [330.896310] hardirqs last disabled at (772590): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [330.896312] softirqs last enabled at (771650): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [330.896316] softirqs last disabled at (771643): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [330.896318] ---[ end trace 0000000000000000 ]---
<6> [330.896321] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [330.897424] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [330.897436] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [330.898156] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [330.898310] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [330.898483] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [330.898740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [330.898873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [330.899008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [330.899137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [330.899266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [330.899393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [330.899527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [330.899654] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [330.899792] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [330.899953] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [330.901325] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [330.911418] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [330.911754] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [330.913242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [330.913390] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [330.913545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [330.913693] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [330.913844] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [330.913997] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [330.914149] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [330.914299] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [330.914451] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [330.914593] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [330.914734] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [330.914870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [330.915007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [330.915143] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [330.915276] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [330.915412] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [330.915540] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [330.915667] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [330.915790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [330.915917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [330.916042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [330.916165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [330.916290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [330.916414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [330.916534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [330.916652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [330.916771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [330.916893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [330.917015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [330.917136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [330.917257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [330.917379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [330.917513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [330.917640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [330.917767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [330.917891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [330.918014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [330.918134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [330.918254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [330.918374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [330.918501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [330.918623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [330.918743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [330.918862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [330.918986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [330.919105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [330.919226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [330.919344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [330.919469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [330.919588] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [330.919706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [330.919828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [330.919948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [330.920068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [330.920187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [330.920308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [330.920432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [330.920551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [330.920674] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [330.920841] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [330.920848] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16429, lrc_seqno=16429, guc_id=0, flags=0x73 in no process [-1]
<7> [330.920851] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [330.920949] ------------[ cut here ]------------
<4> [330.920951] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [330.920953] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#12: kworker/u64:16/3882
<4> [330.921061] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [330.921149] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [330.921160] CPU: 12 UID: 0 PID: 3882 Comm: kworker/u64:16 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [330.921164] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [330.921166] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [330.921167] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [330.921175] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [330.921284] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [330.921286] RSP: 0018:ffffc90003ea7ca0 EFLAGS: 00010246
<4> [330.921289] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [330.921291] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [330.921293] RBP: ffffc90003ea7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [330.921294] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [330.921296] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [330.921298] FS: 0000000000000000(0000) GS:ffff8888db29b000(0000) knlGS:0000000000000000
<4> [330.921300] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [330.921302] CR2: 000072601fe7f000 CR3: 0000000122f7e005 CR4: 0000000000f72ef0
<4> [330.921304] PKRU: 55555554
<4> [330.921305] Call Trace:
<4> [330.921307] <TASK>
<4> [330.921313] ? __pfx_lock_acquire+0x10/0x10
<4> [330.921321] ? lock_release+0xd0/0x2b0
<4> [330.921329] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [330.921338] process_one_work+0x22e/0x740
<4> [330.921349] worker_thread+0x1e8/0x3d0
<4> [330.921354] ? __pfx_worker_thread+0x10/0x10
<4> [330.921358] kthread+0x10d/0x150
<4> [330.921362] ? __pfx_kthread+0x10/0x10
<4> [330.921367] ret_from_fork+0x3d4/0x480
<4> [330.921370] ? __pfx_kthread+0x10/0x10
<4> [330.921375] ret_from_fork_asm+0x1a/0x30
<4> [330.921386] </TASK>
<4> [330.921388] irq event stamp: 775759
<4> [330.921389] hardirqs last enabled at (775765): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [330.921393] hardirqs last disabled at (775770): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [330.921395] softirqs last enabled at (774754): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [330.921399] softirqs last disabled at (774747): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [330.921401] ---[ end trace 0000000000000000 ]---
<7> [330.923358] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [330.923551] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [330.928500] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16438, lrc_seqno=16438, guc_id=0, flags=0x73 in no process [-1]
<7> [330.928505] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [330.928607] ------------[ cut here ]------------
<4> [330.928608] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [330.928610] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#12: kworker/u64:5/204
<4> [330.928719] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [330.928805] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [330.928816] CPU: 12 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [330.928820] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [330.928822] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [330.928824] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [330.928831] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [330.928938] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [330.928941] RSP: 0018:ffffc9000161fca0 EFLAGS: 00010246
<4> [330.928943] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [330.928945] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [330.928947] RBP: ffffc9000161fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [330.928948] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [330.928950] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [330.928952] FS: 0000000000000000(0000) GS:ffff8888db29b000(0000) knlGS:0000000000000000
<4> [330.928954] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [330.928956] CR2: 000072601fe7f000 CR3: 0000000122f7e005 CR4: 0000000000f72ef0
<4> [330.928958] PKRU: 55555554
<4> [330.928959] Call Trace:
<4> [330.928961] <TASK>
<4> [330.928967] ? __pfx_lock_acquire+0x10/0x10
<4> [330.928974] ? lock_release+0xd0/0x2b0
<4> [330.928982] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [330.928991] process_one_work+0x22e/0x740
<4> [330.929002] worker_thread+0x1e8/0x3d0
<4> [330.929007] ? __pfx_worker_thread+0x10/0x10
<4> [330.929011] kthread+0x10d/0x150
<4> [330.929014] ? __pfx_kthread+0x10/0x10
<4> [330.929019] ret_from_fork+0x3d4/0x480
<4> [330.929023] ? __pfx_kthread+0x10/0x10
<4> [330.929028] ret_from_fork_asm+0x1a/0x30
<4> [330.929040] </TASK>
<4> [330.929041] irq event stamp: 1466677
<4> [330.929043] hardirqs last enabled at (1466683): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [330.929046] hardirqs last disabled at (1466688): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [330.929049] softirqs last enabled at (1465418): [<ffffffff81338af3>] kernel_fpu_end+0x53/0x70
<4> [330.929051] softirqs last disabled at (1465416): [<ffffffff81339204>] kernel_fpu_begin_mask+0xc4/0x120
<4> [330.929054] ---[ end trace 0000000000000000 ]---
<6> [330.929057] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [330.929165] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [330.929174] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [330.929602] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [330.929817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [330.929911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [330.930001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [330.930085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [330.930165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [330.930245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [330.930326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [330.930404] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [330.930518] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [330.930633] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [330.931641] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [330.941418] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [330.941677] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [330.942950] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [330.943028] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [330.943102] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [330.943175] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [330.943245] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [330.943314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [330.943384] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [330.943471] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [330.943541] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [330.943610] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [330.943679] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [330.943748] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [330.943818] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [330.943886] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [330.943955] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [330.944021] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [330.944090] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [330.944158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [330.944224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [330.944303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [330.944379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [330.944467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [330.944540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [330.944612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [330.944684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [330.944754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [330.944824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [330.944898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [330.944972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [330.945044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [330.945117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [330.945189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [330.945266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [330.945342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [330.945423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [330.945498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [330.945571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [330.945640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [330.945710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [330.945779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [330.945850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [330.945946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [330.946063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [330.946195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [330.946333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [330.946454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [330.946569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [330.946684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [330.946804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [330.946918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [330.947008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [330.947085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [330.947160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [330.947234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [330.947309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [330.947384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [330.947468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [330.947538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [330.947612] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [330.947735] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [330.947740] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16438, lrc_seqno=16438, guc_id=0, flags=0x73 in no process [-1]
<7> [330.947742] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [330.947800] ------------[ cut here ]------------
<4> [330.947801] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [330.947802] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:5/204
<4> [330.947873] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [330.947931] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [330.947939] CPU: 0 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [330.947942] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [330.947943] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [330.947944] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [330.947949] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [330.948018] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [330.948019] RSP: 0018:ffffc9000161fca0 EFLAGS: 00010246
<4> [330.948021] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [330.948023] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [330.948024] RBP: ffffc9000161fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [330.948025] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [330.948026] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [330.948027] FS: 0000000000000000(0000) GS:ffff8888dac9b000(0000) knlGS:0000000000000000
<4> [330.948029] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [330.948030] CR2: 00005a61f8326358 CR3: 000000000344a005 CR4: 0000000000f72ef0
<4> [330.948031] PKRU: 55555554
<4> [330.948033] Call Trace:
<4> [330.948034] <TASK>
<4> [330.948038] ? __pfx_lock_acquire+0x10/0x10
<4> [330.948043] ? lock_release+0xd0/0x2b0
<4> [330.948048] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [330.948054] process_one_work+0x22e/0x740
<4> [330.948061] worker_thread+0x1e8/0x3d0
<4> [330.948064] ? __pfx_worker_thread+0x10/0x10
<4> [330.948067] kthread+0x10d/0x150
<4> [330.948069] ? __pfx_kthread+0x10/0x10
<4> [330.948073] ret_from_fork+0x3d4/0x480
<4> [330.948075] ? __pfx_kthread+0x10/0x10
<4> [330.948078] ret_from_fork_asm+0x1a/0x30
<4> [330.948085] </TASK>
<4> [330.948086] irq event stamp: 1469771
<4> [330.948087] hardirqs last enabled at (1469777): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [330.948090] hardirqs last disabled at (1469782): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [330.948091] softirqs last enabled at (1468624): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [330.948094] softirqs last disabled at (1468615): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [330.948096] ---[ end trace 0000000000000000 ]---
<6> [330.948098] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [330.948167] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [330.948173] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [330.949457] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [330.949559] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [330.949663] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [330.949874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [330.949963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [330.950052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [330.950134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [330.950214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [330.950293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [330.950371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [330.950469] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [330.950562] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [330.950673] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [330.951681] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [330.962402] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [330.962679] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [330.963958] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [330.964037] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [330.964111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [330.964184] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [330.964256] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [330.964329] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [330.964400] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [330.964487] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [330.964558] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [330.964628] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [330.964697] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [330.964768] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [330.964836] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [330.964905] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [330.964974] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [330.965043] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [330.965111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [330.965179] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [330.965247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [330.965324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [330.965401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [330.965490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [330.965565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [330.965636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [330.965708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [330.965779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [330.965847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [330.965920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [330.965993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [330.966065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [330.966137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [330.966210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [330.966288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [330.966368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [330.966459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [330.966534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [330.966608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [330.966679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [330.966748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [330.966816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [330.966888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [330.966959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [330.967029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [330.967097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [330.967168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [330.967237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [330.967308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [330.967376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [330.967457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [330.967526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [330.967594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [330.967663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [330.967733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [330.967802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [330.967868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [330.967938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [330.968005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [330.968083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [330.968156] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [330.968276] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [330.968281] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16438, lrc_seqno=16438, guc_id=0, flags=0x73 in no process [-1]
<7> [330.968283] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [330.968340] ------------[ cut here ]------------
<4> [330.968341] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [330.968343] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:1/119
<4> [330.968419] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [330.968479] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [330.968486] CPU: 7 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [330.968489] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [330.968491] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [330.968492] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [330.968497] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [330.968565] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [330.968567] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246
<4> [330.968569] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [330.968570] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [330.968572] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000
<4> [330.968573] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [330.968574] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [330.968575] FS: 0000000000000000(0000) GS:ffff8888db01b000(0000) knlGS:0000000000000000
<4> [330.968577] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [330.968578] CR2: 00007a4ade891000 CR3: 000000000344a002 CR4: 0000000000f72ef0
<4> [330.968579] PKRU: 55555554
<4> [330.968580] Call Trace:
<4> [330.968581] <TASK>
<4> [330.968585] ? __pfx_lock_acquire+0x10/0x10
<4> [330.968591] ? lock_release+0xd0/0x2b0
<4> [330.968596] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [330.968601] process_one_work+0x22e/0x740
<4> [330.968608] worker_thread+0x1e8/0x3d0
<4> [330.968611] ? __pfx_worker_thread+0x10/0x10
<4> [330.968614] kthread+0x10d/0x150
<4> [330.968617] ? __pfx_kthread+0x10/0x10
<4> [330.968620] ret_from_fork+0x3d4/0x480
<4> [330.968623] ? __pfx_kthread+0x10/0x10
<4> [330.968626] ret_from_fork_asm+0x1a/0x30
<4> [330.968633] </TASK>
<4> [330.968634] irq event stamp: 714119
<4> [330.968635] hardirqs last enabled at (714125): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [330.968637] hardirqs last disabled at (714130): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [330.968639] softirqs last enabled at (713346): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [330.968641] softirqs last disabled at (713341): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [330.968643] ---[ end trace 0000000000000000 ]---
<7> [330.969832] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [330.969938] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [330.970738] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16439, lrc_seqno=16439, guc_id=0, flags=0x73 in no process [-1]
<7> [330.970742] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [330.970806] ------------[ cut here ]------------
<4> [330.970808] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [330.970809] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:5/204
<4> [330.970884] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [330.970943] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [330.970950] CPU: 0 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [330.970954] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [330.970955] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [330.970956] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [330.970961] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [330.971033] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [330.971035] RSP: 0018:ffffc9000161fca0 EFLAGS: 00010246
<4> [330.971037] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [330.971039] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [330.971040] RBP: ffffc9000161fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [330.971041] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [330.971042] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [330.971043] FS: 0000000000000000(0000) GS:ffff8888dac9b000(0000) knlGS:0000000000000000
<4> [330.971045] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [330.971046] CR2: 00005a61f8326358 CR3: 000000000344a005 CR4: 0000000000f72ef0
<4> [330.971048] PKRU: 55555554
<4> [330.971049] Call Trace:
<4> [330.971050] <TASK>
<4> [330.971054] ? __pfx_lock_acquire+0x10/0x10
<4> [330.971059] ? lock_release+0xd0/0x2b0
<4> [330.971064] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [330.971070] process_one_work+0x22e/0x740
<4> [330.971076] worker_thread+0x1e8/0x3d0
<4> [330.971080] ? __pfx_worker_thread+0x10/0x10
<4> [330.971083] kthread+0x10d/0x150
<4> [330.971085] ? __pfx_kthread+0x10/0x10
<4> [330.971088] ret_from_fork+0x3d4/0x480
<4> [330.971091] ? __pfx_kthread+0x10/0x10
<4> [330.971094] ret_from_fork_asm+0x1a/0x30
<4> [330.971101] </TASK>
<4> [330.971102] irq event stamp: 1471235
<4> [330.971103] hardirqs last enabled at (1471241): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [330.971105] hardirqs last disabled at (1471246): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [330.971107] softirqs last enabled at (1470130): [<ffffffff81338af3>] kernel_fpu_end+0x53/0x70
<4> [330.971109] softirqs last disabled at (1470128): [<ffffffff81339204>] kernel_fpu_begin_mask+0xc4/0x120
<4> [330.971111] ---[ end trace 0000000000000000 ]---
<6> [330.971113] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [330.971183] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [330.971189] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [330.971379] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [330.971607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [330.971696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [330.971786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [330.971869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [330.971950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [330.972029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [330.972125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [330.972200] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [330.972292] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [330.972403] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [330.973452] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [330.983415] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [330.983678] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [330.984985] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [330.985064] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [330.985137] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [330.985212] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [330.985285] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [330.985356] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [330.985434] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [330.985506] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [330.985576] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [330.985646] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [330.985716] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [330.985785] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [330.985854] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [330.985923] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [330.985992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [330.986062] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [330.986130] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [330.986199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [330.986268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [330.986347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [330.986431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [330.986505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [330.986580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [330.986650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [330.986720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [330.986791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [330.986859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [330.986932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [330.987005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [330.987075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [330.987147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [330.987221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [330.987300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [330.987378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [330.987489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [330.987565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [330.987639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [330.987710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [330.987781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [330.987851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [330.987920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [330.987989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [330.988059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [330.988128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [330.988201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [330.988270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [330.988340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [330.988415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [330.988488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [330.988556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [330.988624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [330.988694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [330.988763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [330.988833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [330.988901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [330.988971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [330.989040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [330.989108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [330.989180] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [330.989300] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [330.989304] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16439, lrc_seqno=16439, guc_id=0, flags=0x73 in no process [-1]
<7> [330.989306] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [330.989364] ------------[ cut here ]------------
<4> [330.989365] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [330.989366] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:5/204
<4> [330.989448] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [330.989507] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [330.989515] CPU: 0 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [330.989517] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [330.989518] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [330.989520] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [330.989525] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [330.989593] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [330.989595] RSP: 0018:ffffc9000161fca0 EFLAGS: 00010246
<4> [330.989597] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [330.989598] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [330.989599] RBP: ffffc9000161fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [330.989600] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [330.989601] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [330.989603] FS: 0000000000000000(0000) GS:ffff8888dac9b000(0000) knlGS:0000000000000000
<4> [330.989604] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [330.989605] CR2: 00005a61f8326358 CR3: 000000000344a005 CR4: 0000000000f72ef0
<4> [330.989607] PKRU: 55555554
<4> [330.989608] Call Trace:
<4> [330.989609] <TASK>
<4> [330.989612] ? __pfx_lock_acquire+0x10/0x10
<4> [330.989618] ? lock_release+0xd0/0x2b0
<4> [330.989623] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [330.989628] process_one_work+0x22e/0x740
<4> [330.989635] worker_thread+0x1e8/0x3d0
<4> [330.989638] ? __pfx_worker_thread+0x10/0x10
<4> [330.989641] kthread+0x10d/0x150
<4> [330.989643] ? __pfx_kthread+0x10/0x10
<4> [330.989647] ret_from_fork+0x3d4/0x480
<4> [330.989649] ? __pfx_kthread+0x10/0x10
<4> [330.989652] ret_from_fork_asm+0x1a/0x30
<4> [330.989659] </TASK>
<4> [330.989660] irq event stamp: 1474445
<4> [330.989661] hardirqs last enabled at (1474451): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [330.989664] hardirqs last disabled at (1474456): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [330.989665] softirqs last enabled at (1473492): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [330.989668] softirqs last disabled at (1473485): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [330.989670] ---[ end trace 0000000000000000 ]---
<6> [330.990614] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [330.990718] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [330.990727] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [330.990791] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [330.990937] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [330.991088] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [330.991341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [330.991487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [330.991619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [330.991734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [330.991821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [330.991902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [330.991983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [330.992060] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [330.992152] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [330.992263] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [330.993273] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [331.003415] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [331.003672] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [331.004962] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [331.005040] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [331.005113] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [331.005185] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [331.005256] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [331.005325] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [331.005395] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [331.005495] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [331.005564] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [331.005634] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [331.005702] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [331.005768] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [331.005836] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [331.005904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [331.005969] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [331.006036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [331.006103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [331.006170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [331.006238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [331.006317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [331.006392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [331.006480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [331.006553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [331.006624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [331.006694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [331.006765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [331.006884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [331.007003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [331.007116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [331.007225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [331.007339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [331.007470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [331.007593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [331.007715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [331.007815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [331.007895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [331.007972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [331.008045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [331.008118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [331.008189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [331.008262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [331.008333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [331.008410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [331.008480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [331.008553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [331.008622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [331.008692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [331.008760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [331.008829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [331.008896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [331.008966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [331.009037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [331.009106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [331.009173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [331.009241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [331.009311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [331.009378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [331.009457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [331.009529] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [331.009648] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [331.009653] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16439, lrc_seqno=16439, guc_id=0, flags=0x73 in no process [-1]
<7> [331.009655] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.009712] ------------[ cut here ]------------
<4> [331.009713] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.009714] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:5/204
<4> [331.009785] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.009844] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.009852] CPU: 0 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.009855] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.009856] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.009857] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.009863] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.009929] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.009931] RSP: 0018:ffffc9000161fca0 EFLAGS: 00010246
<4> [331.009933] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.009934] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.009936] RBP: ffffc9000161fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.009937] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.009938] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.009939] FS: 0000000000000000(0000) GS:ffff8888dac9b000(0000) knlGS:0000000000000000
<4> [331.009941] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.009942] CR2: 00005a61f8326358 CR3: 000000000344a005 CR4: 0000000000f72ef0
<4> [331.009943] PKRU: 55555554
<4> [331.009944] Call Trace:
<4> [331.009945] <TASK>
<4> [331.009949] ? __pfx_lock_acquire+0x10/0x10
<4> [331.009955] ? lock_release+0xd0/0x2b0
<4> [331.009959] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.009965] process_one_work+0x22e/0x740
<4> [331.009971] worker_thread+0x1e8/0x3d0
<4> [331.009975] ? __pfx_worker_thread+0x10/0x10
<4> [331.009978] kthread+0x10d/0x150
<4> [331.009980] ? __pfx_kthread+0x10/0x10
<4> [331.009983] ret_from_fork+0x3d4/0x480
<4> [331.009986] ? __pfx_kthread+0x10/0x10
<4> [331.009989] ret_from_fork_asm+0x1a/0x30
<4> [331.009996] </TASK>
<4> [331.009997] irq event stamp: 1477565
<4> [331.009998] hardirqs last enabled at (1477571): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.010000] hardirqs last disabled at (1477576): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.010002] softirqs last enabled at (1476418): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.010004] softirqs last disabled at (1476411): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.010006] ---[ end trace 0000000000000000 ]---
<7> [331.011389] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [331.011505] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [331.014816] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16447, lrc_seqno=16447, guc_id=0, flags=0x73 in no process [-1]
<7> [331.014820] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.014899] ------------[ cut here ]------------
<4> [331.014900] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.014901] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:1/119
<4> [331.014975] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.015035] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.015043] CPU: 7 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.015046] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.015047] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.015048] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.015053] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.015123] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.015125] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246
<4> [331.015127] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.015128] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.015130] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.015131] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.015132] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.015133] FS: 0000000000000000(0000) GS:ffff8888db01b000(0000) knlGS:0000000000000000
<4> [331.015135] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.015136] CR2: 00007a4ade891000 CR3: 000000000344a002 CR4: 0000000000f72ef0
<4> [331.015138] PKRU: 55555554
<4> [331.015139] Call Trace:
<4> [331.015140] <TASK>
<4> [331.015144] ? __pfx_lock_acquire+0x10/0x10
<4> [331.015149] ? lock_release+0xd0/0x2b0
<4> [331.015154] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.015159] process_one_work+0x22e/0x740
<4> [331.015166] worker_thread+0x1e8/0x3d0
<4> [331.015170] ? __pfx_worker_thread+0x10/0x10
<4> [331.015173] kthread+0x10d/0x150
<4> [331.015175] ? __pfx_kthread+0x10/0x10
<4> [331.015178] ret_from_fork+0x3d4/0x480
<4> [331.015181] ? __pfx_kthread+0x10/0x10
<4> [331.015184] ret_from_fork_asm+0x1a/0x30
<4> [331.015191] </TASK>
<4> [331.015192] irq event stamp: 716183
<4> [331.015193] hardirqs last enabled at (716189): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.015196] hardirqs last disabled at (716194): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.015197] softirqs last enabled at (714896): [<ffffffff81338af3>] kernel_fpu_end+0x53/0x70
<4> [331.015199] softirqs last disabled at (714894): [<ffffffff81339204>] kernel_fpu_begin_mask+0xc4/0x120
<4> [331.015201] ---[ end trace 0000000000000000 ]---
<6> [331.015203] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [331.015272] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [331.015278] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [331.015730] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [331.015954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [331.016041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [331.016129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [331.016213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [331.016296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [331.016376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [331.016471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [331.016549] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [331.016640] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [331.016751] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [331.017758] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [331.028414] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [331.028670] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [331.029959] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [331.030036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [331.030109] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [331.030181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [331.030253] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [331.030323] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [331.030392] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [331.030478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [331.030547] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [331.030617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [331.030687] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [331.030756] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [331.030824] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [331.030892] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [331.030961] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [331.031029] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [331.031098] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [331.031167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [331.031235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [331.031314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [331.031390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [331.031520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [331.031596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [331.031666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [331.031736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [331.031807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [331.031877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [331.031950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [331.032023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [331.032095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [331.032167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [331.032239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [331.032316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [331.032393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [331.032486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [331.032561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [331.032634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [331.032704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [331.032775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [331.032845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [331.032915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [331.032985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [331.033055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [331.033127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [331.033202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [331.033274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [331.033344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [331.033421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [331.033496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [331.033564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [331.033635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [331.033708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [331.033780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [331.033851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [331.033920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [331.033990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [331.034059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [331.034127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [331.034199] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [331.034317] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [331.034321] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16447, lrc_seqno=16447, guc_id=0, flags=0x73 in no process [-1]
<7> [331.034324] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.034381] ------------[ cut here ]------------
<4> [331.034382] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.034383] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:5/204
<4> [331.034462] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.034521] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.034529] CPU: 0 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.034532] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.034533] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.034534] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.034540] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.034607] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.034609] RSP: 0018:ffffc9000161fca0 EFLAGS: 00010246
<4> [331.034611] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.034612] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.034613] RBP: ffffc9000161fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.034615] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.034616] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.034617] FS: 0000000000000000(0000) GS:ffff8888dac9b000(0000) knlGS:0000000000000000
<4> [331.034618] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.034620] CR2: 00005a61f8326358 CR3: 000000000344a005 CR4: 0000000000f72ef0
<4> [331.034621] PKRU: 55555554
<4> [331.034622] Call Trace:
<4> [331.034623] <TASK>
<4> [331.034627] ? __pfx_lock_acquire+0x10/0x10
<4> [331.034632] ? lock_release+0xd0/0x2b0
<4> [331.034637] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.034642] process_one_work+0x22e/0x740
<4> [331.034649] worker_thread+0x1e8/0x3d0
<4> [331.034652] ? __pfx_worker_thread+0x10/0x10
<4> [331.034655] kthread+0x10d/0x150
<4> [331.034658] ? __pfx_kthread+0x10/0x10
<4> [331.034661] ret_from_fork+0x3d4/0x480
<4> [331.034664] ? __pfx_kthread+0x10/0x10
<4> [331.034667] ret_from_fork_asm+0x1a/0x30
<4> [331.034673] </TASK>
<4> [331.034674] irq event stamp: 1482081
<4> [331.034675] hardirqs last enabled at (1482087): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.034678] hardirqs last disabled at (1482092): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.034680] softirqs last enabled at (1480934): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.034682] softirqs last disabled at (1480927): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.034684] ---[ end trace 0000000000000000 ]---
<6> [331.034686] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [331.034753] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [331.034759] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [331.036039] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [331.036141] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [331.036256] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [331.036465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [331.036554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [331.036644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [331.036730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [331.036814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [331.036894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [331.036974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [331.037050] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [331.037143] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [331.037261] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [331.038315] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [331.048415] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [331.048671] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [331.049970] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [331.050047] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [331.050119] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [331.050190] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [331.050259] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [331.050330] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [331.050400] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [331.050487] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [331.050558] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [331.050627] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [331.050696] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [331.050766] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [331.050835] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [331.050904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [331.050974] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [331.051045] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [331.051114] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [331.051184] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [331.051252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [331.051329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [331.051412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [331.051489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [331.051563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [331.051634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [331.051707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [331.051779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [331.051850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [331.051922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [331.051995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [331.052067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [331.052139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [331.052210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [331.052287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [331.052363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [331.052452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [331.052527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [331.052601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [331.052671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [331.052742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [331.052812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [331.052885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [331.052955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [331.053026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [331.053095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [331.053168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [331.053236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [331.053305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [331.053373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [331.053454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [331.053523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [331.053590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [331.053662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [331.053742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [331.053814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [331.053884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [331.053955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [331.054024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [331.054091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [331.054163] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [331.054287] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [331.054291] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16447, lrc_seqno=16447, guc_id=0, flags=0x73 in no process [-1]
<7> [331.054293] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.054351] ------------[ cut here ]------------
<4> [331.054352] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.054354] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:1/119
<4> [331.054432] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.054491] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.054499] CPU: 7 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.054502] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.054503] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.054504] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.054509] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.054577] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.054579] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246
<4> [331.054581] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.054582] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.054584] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.054585] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.054586] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.054587] FS: 0000000000000000(0000) GS:ffff8888db01b000(0000) knlGS:0000000000000000
<4> [331.054589] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.054590] CR2: 00007a4ade891000 CR3: 000000000344a002 CR4: 0000000000f72ef0
<4> [331.054591] PKRU: 55555554
<4> [331.054592] Call Trace:
<4> [331.054593] <TASK>
<4> [331.054597] ? __pfx_lock_acquire+0x10/0x10
<4> [331.054602] ? lock_release+0xd0/0x2b0
<4> [331.054607] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.054612] process_one_work+0x22e/0x740
<4> [331.054619] worker_thread+0x1e8/0x3d0
<4> [331.054622] ? __pfx_worker_thread+0x10/0x10
<4> [331.054625] kthread+0x10d/0x150
<4> [331.054627] ? __pfx_kthread+0x10/0x10
<4> [331.054631] ret_from_fork+0x3d4/0x480
<4> [331.054633] ? __pfx_kthread+0x10/0x10
<4> [331.054636] ret_from_fork_asm+0x1a/0x30
<4> [331.054643] </TASK>
<4> [331.054644] irq event stamp: 719539
<4> [331.054645] hardirqs last enabled at (719545): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.054647] hardirqs last disabled at (719550): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.054649] softirqs last enabled at (718390): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.054651] softirqs last disabled at (718383): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.054653] ---[ end trace 0000000000000000 ]---
<7> [331.055714] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [331.055817] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [331.057366] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:558]
<5> [331.057426] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16448, lrc_seqno=16448, guc_id=0, flags=0x73 in no process [-1]
<7> [331.057429] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.057492] ------------[ cut here ]------------
<4> [331.057493] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.057494] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:5/204
<4> [331.057570] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.057628] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.057636] CPU: 0 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.057638] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.057639] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.057641] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.057645] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.057715] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.057717] RSP: 0018:ffffc9000161fca0 EFLAGS: 00010246
<4> [331.057719] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.057720] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.057721] RBP: ffffc9000161fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.057722] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.057723] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.057725] FS: 0000000000000000(0000) GS:ffff8888dac9b000(0000) knlGS:0000000000000000
<4> [331.057726] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.057727] CR2: 00005a61f8326358 CR3: 000000000344a005 CR4: 0000000000f72ef0
<4> [331.057729] PKRU: 55555554
<4> [331.057730] Call Trace:
<4> [331.057731] <TASK>
<4> [331.057734] ? __pfx_lock_acquire+0x10/0x10
<4> [331.057740] ? lock_release+0xd0/0x2b0
<4> [331.057745] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.057750] process_one_work+0x22e/0x740
<4> [331.057757] worker_thread+0x1e8/0x3d0
<4> [331.057760] ? __pfx_worker_thread+0x10/0x10
<4> [331.057763] kthread+0x10d/0x150
<4> [331.057765] ? __pfx_kthread+0x10/0x10
<4> [331.057769] ret_from_fork+0x3d4/0x480
<4> [331.057771] ? __pfx_kthread+0x10/0x10
<4> [331.057774] ret_from_fork_asm+0x1a/0x30
<4> [331.057781] </TASK>
<4> [331.057782] irq event stamp: 1483553
<4> [331.057783] hardirqs last enabled at (1483559): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.057785] hardirqs last disabled at (1483564): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.057787] softirqs last enabled at (1482596): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.057789] softirqs last disabled at (1482591): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.057791] ---[ end trace 0000000000000000 ]---
<6> [331.057793] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [331.057862] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [331.057870] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [331.057925] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [331.058172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [331.058300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [331.058439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [331.058570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [331.058697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [331.058824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [331.058952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [331.059077] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [331.059213] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [331.059373] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [331.060776] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [331.071552] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [331.071869] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [331.073263] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [331.073379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [331.073501] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [331.073618] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [331.073735] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [331.073851] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [331.073967] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [331.074083] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [331.074199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [331.074315] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [331.074434] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [331.074551] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [331.074667] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [331.074783] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [331.074899] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [331.075015] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [331.075131] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [331.075247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [331.075363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [331.075488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [331.075610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [331.075729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [331.075850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [331.075969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [331.076087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [331.076205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [331.076324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [331.076451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [331.076575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [331.076696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [331.076818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [331.076940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [331.077067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [331.077195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [331.077321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [331.077450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [331.077576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [331.077696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [331.077817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [331.077936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [331.078059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [331.078180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [331.078300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [331.078433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [331.078528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [331.078612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [331.078690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [331.078766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [331.078842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [331.078916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [331.078991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [331.079067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [331.079140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [331.079212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [331.079284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [331.079356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [331.079434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [331.079505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [331.079578] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [331.079698] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [331.079702] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16448, lrc_seqno=16448, guc_id=0, flags=0x73 in no process [-1]
<7> [331.079704] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.079762] ------------[ cut here ]------------
<4> [331.079763] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.079764] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:16/3882
<4> [331.079835] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.079893] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.079901] CPU: 0 UID: 0 PID: 3882 Comm: kworker/u64:16 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.079904] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.079905] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.079907] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.079912] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.079980] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.079981] RSP: 0018:ffffc90003ea7ca0 EFLAGS: 00010246
<4> [331.079984] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.079985] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.079986] RBP: ffffc90003ea7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.079987] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.079988] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.079989] FS: 0000000000000000(0000) GS:ffff8888dac9b000(0000) knlGS:0000000000000000
<4> [331.079991] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.079992] CR2: 00005a61f8326358 CR3: 000000000344a005 CR4: 0000000000f72ef0
<4> [331.079993] PKRU: 55555554
<4> [331.079994] Call Trace:
<4> [331.079995] <TASK>
<4> [331.079999] ? __pfx_lock_acquire+0x10/0x10
<4> [331.080004] ? lock_release+0xd0/0x2b0
<4> [331.080009] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.080015] process_one_work+0x22e/0x740
<4> [331.080022] worker_thread+0x1e8/0x3d0
<4> [331.080025] ? __pfx_worker_thread+0x10/0x10
<4> [331.080028] kthread+0x10d/0x150
<4> [331.080030] ? __pfx_kthread+0x10/0x10
<4> [331.080033] ret_from_fork+0x3d4/0x480
<4> [331.080036] ? __pfx_kthread+0x10/0x10
<4> [331.080039] ret_from_fork_asm+0x1a/0x30
<4> [331.080046] </TASK>
<4> [331.080047] irq event stamp: 781151
<4> [331.080048] hardirqs last enabled at (781157): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.080050] hardirqs last disabled at (781162): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.080052] softirqs last enabled at (780258): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.080054] softirqs last disabled at (780251): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.080056] ---[ end trace 0000000000000000 ]---
<6> [331.080058] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [331.080125] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [331.080131] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [331.081420] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [331.081520] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [331.081622] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [331.081834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [331.081927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [331.082019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [331.082103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [331.082185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [331.082261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [331.082341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [331.082420] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [331.082529] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [331.082639] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [331.083653] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [331.093412] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [331.093669] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [331.094963] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [331.095039] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [331.095112] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [331.095186] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [331.095257] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [331.095328] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [331.095399] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [331.095488] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [331.095561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [331.095631] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [331.095700] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [331.095770] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [331.095837] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [331.095904] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [331.095971] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [331.096039] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [331.096107] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [331.096173] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [331.096241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [331.096320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [331.096396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [331.096487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [331.096562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [331.096634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [331.096706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [331.096777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [331.096847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [331.096920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [331.096993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [331.097064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [331.097136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [331.097208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [331.097285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [331.097362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [331.097451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [331.097525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [331.097599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [331.097671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [331.097742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [331.097812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [331.097884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [331.097955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [331.098024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [331.098093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [331.098165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [331.098236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [331.098306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [331.098375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [331.098461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [331.098531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [331.098600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [331.098672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [331.098742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [331.098811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [331.098881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [331.098952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [331.099021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [331.099092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [331.099165] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [331.099284] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [331.099288] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16448, lrc_seqno=16448, guc_id=0, flags=0x73 in no process [-1]
<7> [331.099291] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.099348] ------------[ cut here ]------------
<4> [331.099349] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.099350] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:5/204
<4> [331.099423] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.099483] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.099491] CPU: 2 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.099494] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.099495] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.099496] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.099501] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.099570] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.099571] RSP: 0000:ffffc9000161fca0 EFLAGS: 00010246
<4> [331.099573] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.099575] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.099576] RBP: ffffc9000161fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.099577] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.099578] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.099580] FS: 0000000000000000(0000) GS:ffff8888dad9b000(0000) knlGS:0000000000000000
<4> [331.099581] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.099582] CR2: 00007a4ade889000 CR3: 00000001801f4001 CR4: 0000000000f72ef0
<4> [331.099584] PKRU: 55555554
<4> [331.099585] Call Trace:
<4> [331.099586] <TASK>
<4> [331.099590] ? __pfx_lock_acquire+0x10/0x10
<4> [331.099595] ? lock_release+0xd0/0x2b0
<4> [331.099600] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.099605] process_one_work+0x22e/0x740
<4> [331.099612] worker_thread+0x1e8/0x3d0
<4> [331.099615] ? __pfx_worker_thread+0x10/0x10
<4> [331.099618] kthread+0x10d/0x150
<4> [331.099621] ? __pfx_kthread+0x10/0x10
<4> [331.099624] ret_from_fork+0x3d4/0x480
<4> [331.099627] ? __pfx_kthread+0x10/0x10
<4> [331.099630] ret_from_fork_asm+0x1a/0x30
<4> [331.099636] </TASK>
<4> [331.099637] irq event stamp: 1487157
<4> [331.099638] hardirqs last enabled at (1487163): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.099641] hardirqs last disabled at (1487168): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.099643] softirqs last enabled at (1486106): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.099645] softirqs last disabled at (1486097): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.099647] ---[ end trace 0000000000000000 ]---
<7> [331.100713] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [331.100816] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [331.106434] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16457, lrc_seqno=16457, guc_id=0, flags=0x73 in no process [-1]
<7> [331.106437] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.106501] ------------[ cut here ]------------
<4> [331.106502] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.106503] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:9/208
<4> [331.106577] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.106636] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.106644] CPU: 2 UID: 0 PID: 208 Comm: kworker/u64:9 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.106647] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.106648] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.106649] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.106654] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.106724] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.106725] RSP: 0000:ffffc9000163fca0 EFLAGS: 00010246
<4> [331.106727] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.106729] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.106730] RBP: ffffc9000163fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.106731] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.106732] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.106733] FS: 0000000000000000(0000) GS:ffff8888dad9b000(0000) knlGS:0000000000000000
<4> [331.106735] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.106736] CR2: 00007a4ade889000 CR3: 000000000344a002 CR4: 0000000000f72ef0
<4> [331.106737] PKRU: 55555554
<4> [331.106738] Call Trace:
<4> [331.106739] <TASK>
<4> [331.106743] ? __pfx_lock_acquire+0x10/0x10
<4> [331.106748] ? lock_release+0xd0/0x2b0
<4> [331.106753] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.106758] process_one_work+0x22e/0x740
<4> [331.106765] worker_thread+0x1e8/0x3d0
<4> [331.106768] ? __pfx_worker_thread+0x10/0x10
<4> [331.106771] kthread+0x10d/0x150
<4> [331.106774] ? __pfx_kthread+0x10/0x10
<4> [331.106777] ret_from_fork+0x3d4/0x480
<4> [331.106780] ? __pfx_kthread+0x10/0x10
<4> [331.106783] ret_from_fork_asm+0x1a/0x30
<4> [331.106790] </TASK>
<4> [331.106791] irq event stamp: 1663519
<4> [331.106792] hardirqs last enabled at (1663525): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.106794] hardirqs last disabled at (1663530): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.106796] softirqs last enabled at (1662430): [<ffffffff81338af3>] kernel_fpu_end+0x53/0x70
<4> [331.106798] softirqs last disabled at (1662428): [<ffffffff81339204>] kernel_fpu_begin_mask+0xc4/0x120
<4> [331.106800] ---[ end trace 0000000000000000 ]---
<6> [331.106802] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [331.106870] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [331.106876] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [331.107289] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [331.107510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [331.107602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [331.107693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [331.107777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [331.107857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [331.107937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [331.108017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [331.108095] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [331.108188] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [331.108301] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [331.109323] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [331.119447] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [331.119704] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [331.121005] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [331.121082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [331.121155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [331.121228] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [331.121301] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [331.121372] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [331.121480] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [331.121551] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [331.121621] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [331.121689] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [331.121756] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [331.121826] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [331.121893] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [331.121963] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [331.122032] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [331.122101] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [331.122171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [331.122239] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [331.122308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [331.122386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [331.122476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [331.122550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [331.122624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [331.122696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [331.122766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [331.122834] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [331.122904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [331.122976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [331.123050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [331.123122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [331.123194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [331.123266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [331.123342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [331.123425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [331.123502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [331.123574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [331.123647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [331.123717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [331.123787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [331.123854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [331.123926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [331.123996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [331.124066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [331.124133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [331.124205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [331.124272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [331.124342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [331.124416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [331.124487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [331.124556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [331.124624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [331.124692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [331.124762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [331.124831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [331.124900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [331.124969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [331.125035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [331.125104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [331.125175] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [331.125298] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [331.125302] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16457, lrc_seqno=16457, guc_id=0, flags=0x73 in no process [-1]
<7> [331.125305] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.125361] ------------[ cut here ]------------
<4> [331.125362] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.125364] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:16/3882
<4> [331.125444] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.125504] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.125512] CPU: 4 UID: 0 PID: 3882 Comm: kworker/u64:16 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.125514] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.125516] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.125517] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.125522] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.125591] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.125593] RSP: 0018:ffffc90003ea7ca0 EFLAGS: 00010246
<4> [331.125595] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.125596] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.125598] RBP: ffffc90003ea7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.125599] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.125600] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.125601] FS: 0000000000000000(0000) GS:ffff8888dae9b000(0000) knlGS:0000000000000000
<4> [331.125602] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.125604] CR2: 00007a4ade8a0000 CR3: 0000000122f7e003 CR4: 0000000000f72ef0
<4> [331.125605] PKRU: 55555554
<4> [331.125606] Call Trace:
<4> [331.125607] <TASK>
<4> [331.125611] ? __pfx_lock_acquire+0x10/0x10
<4> [331.125616] ? lock_release+0xd0/0x2b0
<4> [331.125621] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.125627] process_one_work+0x22e/0x740
<4> [331.125634] worker_thread+0x1e8/0x3d0
<4> [331.125637] ? __pfx_worker_thread+0x10/0x10
<4> [331.125640] kthread+0x10d/0x150
<4> [331.125643] ? __pfx_kthread+0x10/0x10
<4> [331.125646] ret_from_fork+0x3d4/0x480
<4> [331.125649] ? __pfx_kthread+0x10/0x10
<4> [331.125652] ret_from_fork_asm+0x1a/0x30
<4> [331.125658] </TASK>
<4> [331.125659] irq event stamp: 785921
<4> [331.125660] hardirqs last enabled at (785927): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.125663] hardirqs last disabled at (785932): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.125665] softirqs last enabled at (784860): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.125667] softirqs last disabled at (784853): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.125669] ---[ end trace 0000000000000000 ]---
<6> [331.125671] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [331.125740] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [331.125746] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [331.126279] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [331.126487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [331.126573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [331.126660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [331.126739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [331.126818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [331.126894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [331.126970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [331.127046] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [331.127137] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [331.127249] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [331.128254] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [331.138987] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [331.139235] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [331.140746] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [331.140826] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [331.140897] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [331.140966] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [331.141034] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [331.141101] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [331.141166] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [331.141231] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [331.141296] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [331.141362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [331.141439] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [331.141511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [331.141581] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [331.141652] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [331.141722] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [331.141793] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [331.141862] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [331.141932] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [331.142001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [331.142081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [331.142160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [331.142283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [331.142401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [331.142549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [331.142660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [331.142775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [331.142890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [331.143001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [331.143081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [331.143157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [331.143232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [331.143306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [331.143386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [331.143520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [331.143605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [331.143684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [331.143760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [331.143832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [331.143904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [331.143975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [331.144049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [331.144121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [331.144192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [331.144261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [331.144335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [331.144416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [331.144491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [331.144560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [331.144631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [331.144699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [331.144768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [331.144840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [331.144910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [331.144980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [331.145051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [331.145122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [331.145191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [331.145261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [331.145334] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [331.145462] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [331.145467] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16457, lrc_seqno=16457, guc_id=0, flags=0x73 in no process [-1]
<7> [331.145469] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.145527] ------------[ cut here ]------------
<4> [331.145528] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.145530] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:16/3882
<4> [331.145600] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.145659] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.145666] CPU: 0 UID: 0 PID: 3882 Comm: kworker/u64:16 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.145669] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.145670] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.145671] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.145676] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.145744] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.145746] RSP: 0018:ffffc90003ea7ca0 EFLAGS: 00010246
<4> [331.145748] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.145749] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.145751] RBP: ffffc90003ea7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.145752] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.145753] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.145754] FS: 0000000000000000(0000) GS:ffff8888dac9b000(0000) knlGS:0000000000000000
<4> [331.145756] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.145757] CR2: 00005a61f8326358 CR3: 000000000344a005 CR4: 0000000000f72ef0
<4> [331.145758] PKRU: 55555554
<4> [331.145759] Call Trace:
<4> [331.145760] <TASK>
<4> [331.145764] ? __pfx_lock_acquire+0x10/0x10
<4> [331.145769] ? lock_release+0xd0/0x2b0
<4> [331.145774] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.145779] process_one_work+0x22e/0x740
<4> [331.145786] worker_thread+0x1e8/0x3d0
<4> [331.145790] ? __pfx_worker_thread+0x10/0x10
<4> [331.145793] kthread+0x10d/0x150
<4> [331.145795] ? __pfx_kthread+0x10/0x10
<4> [331.145798] ret_from_fork+0x3d4/0x480
<4> [331.145801] ? __pfx_kthread+0x10/0x10
<4> [331.145804] ret_from_fork_asm+0x1a/0x30
<4> [331.145810] </TASK>
<4> [331.145811] irq event stamp: 789029
<4> [331.145813] hardirqs last enabled at (789035): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.145815] hardirqs last disabled at (789040): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.145817] softirqs last enabled at (788172): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.145819] softirqs last disabled at (788165): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.145821] ---[ end trace 0000000000000000 ]---
<7> [331.146934] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [331.147035] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [331.148133] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16458, lrc_seqno=16458, guc_id=0, flags=0x73 in no process [-1]
<7> [331.148136] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.148196] ------------[ cut here ]------------
<4> [331.148197] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.148198] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:9/208
<4> [331.148267] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.148324] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.148332] CPU: 2 UID: 0 PID: 208 Comm: kworker/u64:9 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.148334] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.148335] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.148337] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.148341] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.148438] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.148440] RSP: 0018:ffffc9000163fca0 EFLAGS: 00010246
<4> [331.148442] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.148443] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.148444] RBP: ffffc9000163fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.148445] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.148446] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.148448] FS: 0000000000000000(0000) GS:ffff8888dad9b000(0000) knlGS:0000000000000000
<4> [331.148449] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.148450] CR2: 00007a4ade889000 CR3: 0000000122f7e004 CR4: 0000000000f72ef0
<4> [331.148452] PKRU: 55555554
<4> [331.148453] Call Trace:
<4> [331.148454] <TASK>
<4> [331.148457] ? __pfx_lock_acquire+0x10/0x10
<4> [331.148462] ? lock_release+0xd0/0x2b0
<4> [331.148467] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.148473] process_one_work+0x22e/0x740
<4> [331.148479] worker_thread+0x1e8/0x3d0
<4> [331.148483] ? __pfx_worker_thread+0x10/0x10
<4> [331.148486] kthread+0x10d/0x150
<4> [331.148488] ? __pfx_kthread+0x10/0x10
<4> [331.148492] ret_from_fork+0x3d4/0x480
<4> [331.148494] ? __pfx_kthread+0x10/0x10
<4> [331.148498] ret_from_fork_asm+0x1a/0x30
<4> [331.148504] </TASK>
<4> [331.148505] irq event stamp: 1665489
<4> [331.148507] hardirqs last enabled at (1665495): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.148509] hardirqs last disabled at (1665500): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.148511] softirqs last enabled at (1665328): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.148513] softirqs last disabled at (1665177): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.148515] ---[ end trace 0000000000000000 ]---
<6> [331.148516] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [331.148586] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [331.148784] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [331.148833] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [331.149048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [331.149137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [331.149226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [331.149309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [331.149389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [331.149477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [331.149558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [331.149636] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [331.149730] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [331.149842] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [331.150846] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [331.161411] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [331.161667] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [331.162978] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [331.163055] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [331.163127] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [331.163199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [331.163271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [331.163343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [331.163432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [331.163503] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [331.163574] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [331.163645] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [331.163712] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [331.163780] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [331.163848] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [331.163917] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [331.163985] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [331.164050] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [331.164119] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [331.164186] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [331.164254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [331.164330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [331.164410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [331.164485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [331.164558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [331.164629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [331.164699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [331.164770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [331.164837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [331.164911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [331.164986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [331.165059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [331.165131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [331.165204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [331.165282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [331.165358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [331.165441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [331.165516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [331.165589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [331.165659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [331.165729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [331.165797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [331.165866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [331.165934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [331.166004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [331.166072] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [331.166144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [331.166213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [331.166283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [331.166352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [331.166425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [331.166493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [331.166560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [331.166631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [331.166701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [331.166771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [331.166840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [331.166909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [331.166976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [331.167044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [331.167114] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [331.167231] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [331.167235] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16458, lrc_seqno=16458, guc_id=0, flags=0x73 in no process [-1]
<7> [331.167238] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.167294] ------------[ cut here ]------------
<4> [331.167295] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.167296] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:9/208
<4> [331.167366] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.167428] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.167436] CPU: 2 UID: 0 PID: 208 Comm: kworker/u64:9 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.167438] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.167439] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.167441] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.167446] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.167513] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.167515] RSP: 0018:ffffc9000163fca0 EFLAGS: 00010246
<4> [331.167517] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.167518] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.167519] RBP: ffffc9000163fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.167520] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.167521] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.167522] FS: 0000000000000000(0000) GS:ffff8888dad9b000(0000) knlGS:0000000000000000
<4> [331.167524] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.167525] CR2: 00007a4ade889000 CR3: 0000000122f7e004 CR4: 0000000000f72ef0
<4> [331.167527] PKRU: 55555554
<4> [331.167528] Call Trace:
<4> [331.167529] <TASK>
<4> [331.167532] ? __pfx_lock_acquire+0x10/0x10
<4> [331.167537] ? lock_release+0xd0/0x2b0
<4> [331.167542] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.167547] process_one_work+0x22e/0x740
<4> [331.167554] worker_thread+0x1e8/0x3d0
<4> [331.167557] ? __pfx_worker_thread+0x10/0x10
<4> [331.167560] kthread+0x10d/0x150
<4> [331.167563] ? __pfx_kthread+0x10/0x10
<4> [331.167566] ret_from_fork+0x3d4/0x480
<4> [331.167569] ? __pfx_kthread+0x10/0x10
<4> [331.167571] ret_from_fork_asm+0x1a/0x30
<4> [331.167578] </TASK>
<4> [331.167579] irq event stamp: 1668661
<4> [331.167580] hardirqs last enabled at (1668667): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.167582] hardirqs last disabled at (1668672): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.167584] softirqs last enabled at (1667714): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.167586] softirqs last disabled at (1667709): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.167588] ---[ end trace 0000000000000000 ]---
<6> [331.167590] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [331.167659] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [331.167666] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [331.168075] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [331.168277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [331.168362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [331.168459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [331.168542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [331.168621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [331.168699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [331.168778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [331.168854] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [331.168946] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [331.169057] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [331.170060] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [331.180760] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [331.181016] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [331.182287] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [331.182362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [331.182443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [331.182515] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [331.182588] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [331.182660] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [331.182730] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [331.182800] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [331.182870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [331.182939] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [331.183008] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [331.183079] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [331.183149] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [331.183216] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [331.183285] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [331.183352] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [331.183426] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [331.183496] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [331.183564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [331.183639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [331.183715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [331.183788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [331.183861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [331.183932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [331.184004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [331.184076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [331.184147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [331.184219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [331.184292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [331.184362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [331.184442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [331.184514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [331.184592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [331.184670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [331.184748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [331.184820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [331.184892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [331.184962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [331.185031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [331.185101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [331.185173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [331.185243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [331.185313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [331.185382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [331.185463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [331.185533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [331.185603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [331.185670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [331.185740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [331.185808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [331.185875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [331.185944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [331.186011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [331.186079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [331.186148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [331.186216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [331.186281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [331.186349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [331.186426] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [331.186543] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [331.186547] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16458, lrc_seqno=16458, guc_id=0, flags=0x73 in no process [-1]
<7> [331.186549] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.186606] ------------[ cut here ]------------
<4> [331.186607] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.186608] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:9/208
<4> [331.186678] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.186736] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.186743] CPU: 2 UID: 0 PID: 208 Comm: kworker/u64:9 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.186745] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.186746] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.186748] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.186752] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.186821] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.186822] RSP: 0018:ffffc9000163fca0 EFLAGS: 00010246
<4> [331.186824] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.186825] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.186826] RBP: ffffc9000163fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.186828] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.186829] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.186830] FS: 0000000000000000(0000) GS:ffff8888dad9b000(0000) knlGS:0000000000000000
<4> [331.186831] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.186833] CR2: 00007a4ade889000 CR3: 000000000344a002 CR4: 0000000000f72ef0
<4> [331.186834] PKRU: 55555554
<4> [331.186835] Call Trace:
<4> [331.186836] <TASK>
<4> [331.186839] ? __pfx_lock_acquire+0x10/0x10
<4> [331.186844] ? lock_release+0xd0/0x2b0
<4> [331.186849] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.186855] process_one_work+0x22e/0x740
<4> [331.186861] worker_thread+0x1e8/0x3d0
<4> [331.186864] ? __pfx_worker_thread+0x10/0x10
<4> [331.186867] kthread+0x10d/0x150
<4> [331.186870] ? __pfx_kthread+0x10/0x10
<4> [331.186873] ret_from_fork+0x3d4/0x480
<4> [331.186876] ? __pfx_kthread+0x10/0x10
<4> [331.186879] ret_from_fork_asm+0x1a/0x30
<4> [331.186885] </TASK>
<4> [331.186886] irq event stamp: 1671775
<4> [331.186887] hardirqs last enabled at (1671781): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.186890] hardirqs last disabled at (1671786): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.186892] softirqs last enabled at (1670800): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.186894] softirqs last disabled at (1670793): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.186896] ---[ end trace 0000000000000000 ]---
<7> [331.188281] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [331.188387] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [331.192006] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16466, lrc_seqno=16466, guc_id=0, flags=0x73 in no process [-1]
<7> [331.192011] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.192081] ------------[ cut here ]------------
<4> [331.192082] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.192084] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:1/119
<4> [331.192162] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.192220] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.192228] CPU: 6 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.192231] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.192232] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.192233] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.192238] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.192308] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.192310] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246
<4> [331.192312] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.192313] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.192315] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.192316] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.192317] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.192318] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000
<4> [331.192319] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.192321] CR2: 000072601fe8a000 CR3: 000000011422a003 CR4: 0000000000f72ef0
<4> [331.192322] PKRU: 55555554
<4> [331.192323] Call Trace:
<4> [331.192324] <TASK>
<4> [331.192328] ? __pfx_lock_acquire+0x10/0x10
<4> [331.192333] ? lock_release+0xd0/0x2b0
<4> [331.192338] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.192343] process_one_work+0x22e/0x740
<4> [331.192350] worker_thread+0x1e8/0x3d0
<4> [331.192354] ? __pfx_worker_thread+0x10/0x10
<4> [331.192356] kthread+0x10d/0x150
<4> [331.192359] ? __pfx_kthread+0x10/0x10
<4> [331.192362] ret_from_fork+0x3d4/0x480
<4> [331.192365] ? __pfx_kthread+0x10/0x10
<4> [331.192368] ret_from_fork_asm+0x1a/0x30
<4> [331.192375] </TASK>
<4> [331.192376] irq event stamp: 720991
<4> [331.192377] hardirqs last enabled at (720997): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.192379] hardirqs last disabled at (721002): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.192381] softirqs last enabled at (720094): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.192383] softirqs last disabled at (720089): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.192385] ---[ end trace 0000000000000000 ]---
<6> [331.192387] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [331.192468] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [331.192475] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [331.193009] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [331.193212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [331.193300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [331.193389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [331.193484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [331.193567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [331.193646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [331.193726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [331.193805] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [331.193898] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [331.194010] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [331.195029] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [331.205412] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [331.205670] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [331.206935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [331.207012] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [331.207084] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [331.207156] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [331.207225] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [331.207295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [331.207363] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [331.207467] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [331.207537] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [331.207607] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [331.207674] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [331.207742] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [331.207808] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [331.207875] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [331.207945] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [331.208013] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [331.208082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [331.208151] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [331.208220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [331.208299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [331.208374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [331.208459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [331.208546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [331.208618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [331.208689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [331.208759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [331.208829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [331.208899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [331.208972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [331.209044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [331.209117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [331.209189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [331.209265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [331.209341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [331.209423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [331.209500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [331.209574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [331.209645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [331.209716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [331.209784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [331.209855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [331.209924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [331.209994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [331.210062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [331.210137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [331.210209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [331.210281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [331.210350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [331.210424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [331.210493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [331.210563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [331.210634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [331.210701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [331.210768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [331.210838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [331.210908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [331.210977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [331.211044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [331.211116] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [331.211237] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [331.211241] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16466, lrc_seqno=16466, guc_id=0, flags=0x73 in no process [-1]
<7> [331.211243] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.211300] ------------[ cut here ]------------
<4> [331.211301] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.211302] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:1/119
<4> [331.211372] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.211435] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.211442] CPU: 6 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.211445] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.211446] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.211448] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.211453] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.211521] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.211522] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246
<4> [331.211524] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.211526] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.211527] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.211528] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.211529] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.211530] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000
<4> [331.211532] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.211533] CR2: 000072601fe8a000 CR3: 000000011422a003 CR4: 0000000000f72ef0
<4> [331.211535] PKRU: 55555554
<4> [331.211536] Call Trace:
<4> [331.211537] <TASK>
<4> [331.211540] ? __pfx_lock_acquire+0x10/0x10
<4> [331.211545] ? lock_release+0xd0/0x2b0
<4> [331.211550] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.211556] process_one_work+0x22e/0x740
<4> [331.211562] worker_thread+0x1e8/0x3d0
<4> [331.211566] ? __pfx_worker_thread+0x10/0x10
<4> [331.211569] kthread+0x10d/0x150
<4> [331.211571] ? __pfx_kthread+0x10/0x10
<4> [331.211574] ret_from_fork+0x3d4/0x480
<4> [331.211577] ? __pfx_kthread+0x10/0x10
<4> [331.211580] ret_from_fork_asm+0x1a/0x30
<4> [331.211587] </TASK>
<4> [331.211588] irq event stamp: 724259
<4> [331.211589] hardirqs last enabled at (724265): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.211591] hardirqs last disabled at (724270): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.211593] softirqs last enabled at (723110): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.211595] softirqs last disabled at (723101): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.211597] ---[ end trace 0000000000000000 ]---
<6> [331.212528] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [331.212598] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [331.212606] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [331.212664] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [331.212763] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [331.212866] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [331.213077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [331.213168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [331.213259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [331.213344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [331.213433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [331.213516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [331.213597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [331.213674] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [331.213767] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [331.213879] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [331.214885] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [331.225414] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [331.225669] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [331.226902] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [331.226978] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [331.227051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [331.227122] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [331.227194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [331.227265] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [331.227333] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [331.227407] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [331.227476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [331.227545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [331.227613] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [331.227679] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [331.227749] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [331.227819] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [331.227887] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [331.227957] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [331.228025] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [331.228093] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [331.228162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [331.228239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [331.228315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [331.228389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [331.228487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [331.228559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [331.228630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [331.228699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [331.228768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [331.228841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [331.228914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [331.228985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [331.229056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [331.229127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [331.229206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [331.229284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [331.229361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [331.229447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [331.229519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [331.229589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [331.229659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [331.229728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [331.229802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [331.229874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [331.229944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [331.230014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [331.230085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [331.230154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [331.230224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [331.230292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [331.230363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [331.230442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [331.230510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [331.230581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [331.230650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [331.230720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [331.230788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [331.230860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [331.230928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [331.230996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [331.231068] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [331.231187] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [331.231191] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16466, lrc_seqno=16466, guc_id=0, flags=0x73 in no process [-1]
<7> [331.231193] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.231250] ------------[ cut here ]------------
<4> [331.231251] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.231253] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:9/208
<4> [331.231323] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.231382] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.231390] CPU: 4 UID: 0 PID: 208 Comm: kworker/u64:9 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.231393] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.231394] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.231396] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.231401] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.231487] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.231489] RSP: 0018:ffffc9000163fca0 EFLAGS: 00010246
<4> [331.231491] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.231493] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.231494] RBP: ffffc9000163fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.231495] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.231497] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.231498] FS: 0000000000000000(0000) GS:ffff8888dae9b000(0000) knlGS:0000000000000000
<4> [331.231500] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.231501] CR2: 00007a4ade8a0000 CR3: 0000000122f7e003 CR4: 0000000000f72ef0
<4> [331.231503] PKRU: 55555554
<4> [331.231504] Call Trace:
<4> [331.231505] <TASK>
<4> [331.231509] ? __pfx_lock_acquire+0x10/0x10
<4> [331.231515] ? lock_release+0xd0/0x2b0
<4> [331.231520] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.231526] process_one_work+0x22e/0x740
<4> [331.231532] worker_thread+0x1e8/0x3d0
<4> [331.231536] ? __pfx_worker_thread+0x10/0x10
<4> [331.231539] kthread+0x10d/0x150
<4> [331.231541] ? __pfx_kthread+0x10/0x10
<4> [331.231544] ret_from_fork+0x3d4/0x480
<4> [331.231547] ? __pfx_kthread+0x10/0x10
<4> [331.231551] ret_from_fork_asm+0x1a/0x30
<4> [331.231558] </TASK>
<4> [331.231559] irq event stamp: 1676445
<4> [331.231560] hardirqs last enabled at (1676451): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.231562] hardirqs last disabled at (1676456): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.231564] softirqs last enabled at (1675404): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.231566] softirqs last disabled at (1675397): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.231569] ---[ end trace 0000000000000000 ]---
<7> [331.232634] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [331.232738] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [331.234514] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16467, lrc_seqno=16467, guc_id=0, flags=0x73 in no process [-1]
<7> [331.234541] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:559]
<7> [331.234518] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.234579] ------------[ cut here ]------------
<4> [331.234580] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.234582] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:9/208
<4> [331.234655] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.234713] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.234721] CPU: 5 UID: 0 PID: 208 Comm: kworker/u64:9 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.234724] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.234725] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.234726] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.234732] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.234801] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.234802] RSP: 0018:ffffc9000163fca0 EFLAGS: 00010246
<4> [331.234804] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.234806] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.234807] RBP: ffffc9000163fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.234808] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.234809] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.234810] FS: 0000000000000000(0000) GS:ffff8888daf1b000(0000) knlGS:0000000000000000
<4> [331.234812] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.234813] CR2: 00007a4ade889000 CR3: 000000000344a005 CR4: 0000000000f72ef0
<4> [331.234815] PKRU: 55555554
<4> [331.234816] Call Trace:
<4> [331.234817] <TASK>
<4> [331.234820] ? __pfx_lock_acquire+0x10/0x10
<4> [331.234825] ? lock_release+0xd0/0x2b0
<4> [331.234830] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.234835] process_one_work+0x22e/0x740
<4> [331.234842] worker_thread+0x1e8/0x3d0
<4> [331.234846] ? __pfx_worker_thread+0x10/0x10
<4> [331.234849] kthread+0x10d/0x150
<4> [331.234851] ? __pfx_kthread+0x10/0x10
<4> [331.234854] ret_from_fork+0x3d4/0x480
<4> [331.234857] ? __pfx_kthread+0x10/0x10
<4> [331.234860] ret_from_fork_asm+0x1a/0x30
<4> [331.234867] </TASK>
<4> [331.234868] irq event stamp: 1677347
<4> [331.234869] hardirqs last enabled at (1677353): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.234871] hardirqs last disabled at (1677358): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.234873] softirqs last enabled at (1675404): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.234875] softirqs last disabled at (1675397): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.234877] ---[ end trace 0000000000000000 ]---
<6> [331.234879] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [331.234947] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [331.234953] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [331.235171] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [331.235397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [331.235532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [331.235622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [331.235718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [331.235800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [331.235879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [331.235962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [331.236040] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [331.236132] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [331.236244] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [331.237253] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [331.247411] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [331.247669] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [331.248932] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [331.249010] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [331.249082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [331.249153] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [331.249225] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [331.249296] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [331.249367] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [331.249448] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [331.249517] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [331.249586] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [331.249654] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [331.249722] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [331.249790] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [331.249857] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [331.249923] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [331.249989] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [331.250055] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [331.250123] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [331.250190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [331.250267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [331.250343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [331.250432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [331.250506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [331.250578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [331.250648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [331.250718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [331.250788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [331.250861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [331.250934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [331.251007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [331.251079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [331.251151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [331.251228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [331.251304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [331.251381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [331.251467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [331.251540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [331.251611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [331.251680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [331.251750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [331.251822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [331.251891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [331.251962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [331.252032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [331.252106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [331.252175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [331.252245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [331.252313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [331.252382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [331.252463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [331.252533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [331.252605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [331.252674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [331.252747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [331.252818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [331.252889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [331.252959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [331.253029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [331.253102] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [331.253222] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [331.253226] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16467, lrc_seqno=16467, guc_id=0, flags=0x73 in no process [-1]
<7> [331.253228] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.253286] ------------[ cut here ]------------
<4> [331.253287] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.253288] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:9/208
<4> [331.253357] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.253432] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.253445] CPU: 5 UID: 0 PID: 208 Comm: kworker/u64:9 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.253448] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.253449] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.253450] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.253455] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.253524] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.253526] RSP: 0018:ffffc9000163fca0 EFLAGS: 00010246
<4> [331.253528] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.253529] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.253530] RBP: ffffc9000163fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.253531] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.253532] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.253534] FS: 0000000000000000(0000) GS:ffff8888daf1b000(0000) knlGS:0000000000000000
<4> [331.253535] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.253536] CR2: 00007a4ade889000 CR3: 000000000344a005 CR4: 0000000000f72ef0
<4> [331.253538] PKRU: 55555554
<4> [331.253539] Call Trace:
<4> [331.253540] <TASK>
<4> [331.253543] ? __pfx_lock_acquire+0x10/0x10
<4> [331.253549] ? lock_release+0xd0/0x2b0
<4> [331.253554] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.253559] process_one_work+0x22e/0x740
<4> [331.253566] worker_thread+0x1e8/0x3d0
<4> [331.253569] ? __pfx_worker_thread+0x10/0x10
<4> [331.253572] kthread+0x10d/0x150
<4> [331.253574] ? __pfx_kthread+0x10/0x10
<4> [331.253578] ret_from_fork+0x3d4/0x480
<4> [331.253580] ? __pfx_kthread+0x10/0x10
<4> [331.253583] ret_from_fork_asm+0x1a/0x30
<4> [331.253590] </TASK>
<4> [331.253591] irq event stamp: 1680475
<4> [331.253592] hardirqs last enabled at (1680481): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.253594] hardirqs last disabled at (1680486): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.253596] softirqs last enabled at (1679434): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.253598] softirqs last disabled at (1679427): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.253600] ---[ end trace 0000000000000000 ]---
<6> [331.254424] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [331.254575] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [331.254582] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [331.254661] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [331.254760] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [331.254864] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [331.255067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [331.255150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [331.255237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [331.255318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [331.255397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [331.255493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [331.255573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [331.255648] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [331.255740] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [331.255851] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [331.256857] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [331.267422] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [331.267678] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [331.268941] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [331.269020] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [331.269092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [331.269161] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [331.269228] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [331.269293] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [331.269358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [331.269430] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [331.269500] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [331.269570] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [331.269640] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [331.269708] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [331.269778] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [331.269847] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [331.269917] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [331.269986] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [331.270054] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [331.270123] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [331.270191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [331.270271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [331.270348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [331.270443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [331.270518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [331.270590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [331.270662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [331.270733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [331.270804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [331.270877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [331.270951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [331.271023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [331.271096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [331.271168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [331.271245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [331.271324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [331.271406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [331.271481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [331.271555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [331.271625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [331.271696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [331.271765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [331.271838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [331.271909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [331.271978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [331.272047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [331.272121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [331.272192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [331.272265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [331.272335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [331.272412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [331.272486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [331.272556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [331.272628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [331.272699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [331.272769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [331.272837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [331.272908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [331.272976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [331.273044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [331.273115] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [331.273233] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [331.273237] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16467, lrc_seqno=16467, guc_id=0, flags=0x73 in no process [-1]
<7> [331.273240] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.273297] ------------[ cut here ]------------
<4> [331.273298] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.273299] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:9/208
<4> [331.273369] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.273438] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.273446] CPU: 2 UID: 0 PID: 208 Comm: kworker/u64:9 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.273449] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.273450] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.273451] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.273456] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.273524] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.273525] RSP: 0000:ffffc9000163fca0 EFLAGS: 00010246
<4> [331.273528] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.273529] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.273530] RBP: ffffc9000163fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.273531] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.273532] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.273534] FS: 0000000000000000(0000) GS:ffff8888dad9b000(0000) knlGS:0000000000000000
<4> [331.273535] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.273537] CR2: 00007a4ade889000 CR3: 00000001801f4001 CR4: 0000000000f72ef0
<4> [331.273538] PKRU: 55555554
<4> [331.273539] Call Trace:
<4> [331.273540] <TASK>
<4> [331.273544] ? __pfx_lock_acquire+0x10/0x10
<4> [331.273549] ? lock_release+0xd0/0x2b0
<4> [331.273554] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.273560] process_one_work+0x22e/0x740
<4> [331.273566] worker_thread+0x1e8/0x3d0
<4> [331.273570] ? __pfx_worker_thread+0x10/0x10
<4> [331.273573] kthread+0x10d/0x150
<4> [331.273575] ? __pfx_kthread+0x10/0x10
<4> [331.273578] ret_from_fork+0x3d4/0x480
<4> [331.273581] ? __pfx_kthread+0x10/0x10
<4> [331.273584] ret_from_fork_asm+0x1a/0x30
<4> [331.273591] </TASK>
<4> [331.273592] irq event stamp: 1683667
<4> [331.273593] hardirqs last enabled at (1683673): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.273596] hardirqs last disabled at (1683678): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.273597] softirqs last enabled at (1682720): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.273599] softirqs last disabled at (1682713): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.273601] ---[ end trace 0000000000000000 ]---
<7> [331.274966] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [331.275070] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [331.280324] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16476, lrc_seqno=16476, guc_id=0, flags=0x73 in no process [-1]
<7> [331.280329] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.280412] ------------[ cut here ]------------
<4> [331.280413] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.280415] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:1/119
<4> [331.280496] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.280556] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.280564] CPU: 6 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.280567] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.280568] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.280569] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.280575] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.280650] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.280652] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246
<4> [331.280654] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.280655] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.280656] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.280657] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.280659] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.280660] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000
<4> [331.280661] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.280663] CR2: 000072601fe8a000 CR3: 000000000344a005 CR4: 0000000000f72ef0
<4> [331.280664] PKRU: 55555554
<4> [331.280665] Call Trace:
<4> [331.280666] <TASK>
<4> [331.280670] ? __pfx_lock_acquire+0x10/0x10
<4> [331.280676] ? lock_release+0xd0/0x2b0
<4> [331.280681] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.280686] process_one_work+0x22e/0x740
<4> [331.280694] worker_thread+0x1e8/0x3d0
<4> [331.280697] ? __pfx_worker_thread+0x10/0x10
<4> [331.280700] kthread+0x10d/0x150
<4> [331.280702] ? __pfx_kthread+0x10/0x10
<4> [331.280706] ret_from_fork+0x3d4/0x480
<4> [331.280709] ? __pfx_kthread+0x10/0x10
<4> [331.280712] ret_from_fork_asm+0x1a/0x30
<4> [331.280719] </TASK>
<4> [331.280720] irq event stamp: 725245
<4> [331.280721] hardirqs last enabled at (725251): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.280723] hardirqs last disabled at (725256): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.280725] softirqs last enabled at (724458): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.280727] softirqs last disabled at (724451): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.280729] ---[ end trace 0000000000000000 ]---
<6> [331.280731] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [331.280805] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [331.280812] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [331.281261] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [331.281473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [331.281568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [331.281662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [331.281751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [331.281838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [331.281922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [331.282005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [331.282086] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [331.282184] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [331.282302] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [331.283325] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [331.294050] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [331.294311] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [331.295566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [331.295652] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [331.295730] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [331.295805] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [331.295880] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [331.295955] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [331.296029] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [331.296103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [331.296177] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [331.296249] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [331.296322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [331.296393] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [331.296479] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [331.296552] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [331.296624] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [331.296695] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [331.296766] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [331.296838] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [331.296909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [331.296989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [331.297069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [331.297148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [331.297228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [331.297307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [331.297384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [331.297468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [331.297544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [331.297621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [331.297699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [331.297776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [331.297852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [331.297928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [331.298009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [331.298090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [331.298171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [331.298249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [331.298324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [331.298397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [331.298485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [331.298559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [331.298637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [331.298712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [331.298787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [331.298859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [331.298936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [331.299008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [331.299082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [331.299155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [331.299229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [331.299300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [331.299371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [331.299453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [331.299527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [331.299601] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [331.299673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [331.299747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [331.299821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [331.299897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [331.299976] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [331.300101] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [331.300105] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16476, lrc_seqno=16476, guc_id=0, flags=0x73 in no process [-1]
<7> [331.300108] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.300168] ------------[ cut here ]------------
<4> [331.300169] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.300170] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:1/119
<4> [331.300245] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.300302] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.300309] CPU: 6 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.300312] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.300313] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.300315] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.300320] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.300393] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.300394] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246
<4> [331.300396] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.300398] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.300399] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.300400] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.300401] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.300406] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000
<4> [331.300407] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.300409] CR2: 000072601fe8a000 CR3: 000000000344a005 CR4: 0000000000f72ef0
<4> [331.300410] PKRU: 55555554
<4> [331.300411] Call Trace:
<4> [331.300412] <TASK>
<4> [331.300416] ? __pfx_lock_acquire+0x10/0x10
<4> [331.300422] ? lock_release+0xd0/0x2b0
<4> [331.300427] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.300432] process_one_work+0x22e/0x740
<4> [331.300439] worker_thread+0x1e8/0x3d0
<4> [331.300442] ? __pfx_worker_thread+0x10/0x10
<4> [331.300445] kthread+0x10d/0x150
<4> [331.300448] ? __pfx_kthread+0x10/0x10
<4> [331.300451] ret_from_fork+0x3d4/0x480
<4> [331.300454] ? __pfx_kthread+0x10/0x10
<4> [331.300457] ret_from_fork_asm+0x1a/0x30
<4> [331.300464] </TASK>
<4> [331.300465] irq event stamp: 728339
<4> [331.300466] hardirqs last enabled at (728345): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.300469] hardirqs last disabled at (728350): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.300471] softirqs last enabled at (727410): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.300473] softirqs last disabled at (727403): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.300475] ---[ end trace 0000000000000000 ]---
<6> [331.300476] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [331.300549] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [331.300554] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [331.300962] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [331.301166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [331.301254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [331.301344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [331.301432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [331.301516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [331.301599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [331.301682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [331.301762] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [331.301860] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [331.301977] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [331.302999] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [331.313723] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [331.313984] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [331.315285] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [331.315368] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [331.315455] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [331.315533] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [331.315608] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [331.315682] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [331.315756] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [331.315830] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [331.315901] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [331.315973] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [331.316045] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [331.316116] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [331.316186] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [331.316257] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [331.316328] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [331.316400] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [331.316486] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [331.316558] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [331.316629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [331.316712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [331.316793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [331.316872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [331.316949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [331.317025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [331.317102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [331.317177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [331.317251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [331.317328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [331.317408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [331.317484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [331.317561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [331.317637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [331.317719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [331.317801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [331.317883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [331.317962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [331.318040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [331.318113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [331.318187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [331.318260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [331.318336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [331.318414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [331.318488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [331.318562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [331.318637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [331.318712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [331.318787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [331.318864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [331.318942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [331.319017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [331.319091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [331.319169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [331.319244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [331.319319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [331.319390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [331.319478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [331.319551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [331.319624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [331.319699] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [331.319823] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [331.319827] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16476, lrc_seqno=16476, guc_id=0, flags=0x73 in no process [-1]
<7> [331.319829] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.319889] ------------[ cut here ]------------
<4> [331.319890] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.319891] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:1/119
<4> [331.319965] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.320022] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.320029] CPU: 6 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.320032] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.320033] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.320034] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.320039] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.320112] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.320113] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246
<4> [331.320115] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.320116] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.320117] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.320119] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.320120] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.320121] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000
<4> [331.320123] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.320124] CR2: 000072601fe8a000 CR3: 000000000344a005 CR4: 0000000000f72ef0
<4> [331.320125] PKRU: 55555554
<4> [331.320126] Call Trace:
<4> [331.320127] <TASK>
<4> [331.320131] ? __pfx_lock_acquire+0x10/0x10
<4> [331.320136] ? lock_release+0xd0/0x2b0
<4> [331.320140] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.320146] process_one_work+0x22e/0x740
<4> [331.320152] worker_thread+0x1e8/0x3d0
<4> [331.320156] ? __pfx_worker_thread+0x10/0x10
<4> [331.320159] kthread+0x10d/0x150
<4> [331.320161] ? __pfx_kthread+0x10/0x10
<4> [331.320164] ret_from_fork+0x3d4/0x480
<4> [331.320167] ? __pfx_kthread+0x10/0x10
<4> [331.320170] ret_from_fork_asm+0x1a/0x30
<4> [331.320177] </TASK>
<4> [331.320178] irq event stamp: 731445
<4> [331.320179] hardirqs last enabled at (731451): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.320181] hardirqs last disabled at (731456): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.320183] softirqs last enabled at (730546): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.320185] softirqs last disabled at (730539): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.320187] ---[ end trace 0000000000000000 ]---
<7> [331.321274] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [331.321386] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [331.322176] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16477, lrc_seqno=16477, guc_id=0, flags=0x73 in no process [-1]
<7> [331.322180] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.322242] ------------[ cut here ]------------
<4> [331.322243] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.322245] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:9/208
<4> [331.322319] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.322376] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.322384] CPU: 2 UID: 0 PID: 208 Comm: kworker/u64:9 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.322387] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.322388] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.322389] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.322394] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.322483] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.322485] RSP: 0000:ffffc9000163fca0 EFLAGS: 00010246
<4> [331.322487] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.322488] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.322490] RBP: ffffc9000163fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.322491] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.322492] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.322493] FS: 0000000000000000(0000) GS:ffff8888dad9b000(0000) knlGS:0000000000000000
<4> [331.322494] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.322496] CR2: 00007a4ade889000 CR3: 000000000344a002 CR4: 0000000000f72ef0
<4> [331.322497] PKRU: 55555554
<4> [331.322498] Call Trace:
<4> [331.322499] <TASK>
<4> [331.322503] ? __pfx_lock_acquire+0x10/0x10
<4> [331.322509] ? lock_release+0xd0/0x2b0
<4> [331.322514] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.322519] process_one_work+0x22e/0x740
<4> [331.322526] worker_thread+0x1e8/0x3d0
<4> [331.322529] ? __pfx_worker_thread+0x10/0x10
<4> [331.322532] kthread+0x10d/0x150
<4> [331.322535] ? __pfx_kthread+0x10/0x10
<4> [331.322538] ret_from_fork+0x3d4/0x480
<4> [331.322541] ? __pfx_kthread+0x10/0x10
<4> [331.322544] ret_from_fork_asm+0x1a/0x30
<4> [331.322551] </TASK>
<4> [331.322552] irq event stamp: 1686869
<4> [331.322553] hardirqs last enabled at (1686875): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.322556] hardirqs last disabled at (1686880): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.322557] softirqs last enabled at (1686708): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.322560] softirqs last disabled at (1686691): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.322562] ---[ end trace 0000000000000000 ]---
<6> [331.322563] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [331.322635] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [331.322641] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [331.322787] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [331.323040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [331.323132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [331.323223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [331.323306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [331.323427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [331.323518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [331.323598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [331.323675] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [331.323768] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [331.323879] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [331.324884] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [331.335409] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [331.335666] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [331.336944] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [331.337020] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [331.337092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [331.337166] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [331.337238] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [331.337310] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [331.337380] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [331.337462] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [331.337532] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [331.337601] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [331.337671] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [331.337740] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [331.337809] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [331.337877] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [331.337946] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [331.338014] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [331.338083] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [331.338150] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [331.338218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [331.338296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [331.338372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [331.338455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [331.338532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [331.338603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [331.338674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [331.338744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [331.338813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [331.338885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [331.338957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [331.339028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [331.339099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [331.339171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [331.339247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [331.339323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [331.339399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [331.339487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [331.339560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [331.339630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [331.339700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [331.339768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [331.339841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [331.339911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [331.339981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [331.340050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [331.340121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [331.340189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [331.340258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [331.340326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [331.340398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [331.340479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [331.340549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [331.340621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [331.340691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [331.340760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [331.340829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [331.340898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [331.340966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [331.341037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [331.341111] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [331.341231] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [331.341235] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16477, lrc_seqno=16477, guc_id=0, flags=0x73 in no process [-1]
<7> [331.341237] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.341294] ------------[ cut here ]------------
<4> [331.341295] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.341297] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/119
<4> [331.341367] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.341430] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.341438] CPU: 10 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.341441] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.341442] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.341443] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.341448] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.341516] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.341518] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246
<4> [331.341520] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.341521] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.341522] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.341523] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.341524] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.341526] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000
<4> [331.341527] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.341528] CR2: 00007a4ade8a0000 CR3: 0000000122f7e006 CR4: 0000000000f72ef0
<4> [331.341530] PKRU: 55555554
<4> [331.341531] Call Trace:
<4> [331.341532] <TASK>
<4> [331.341536] ? __pfx_lock_acquire+0x10/0x10
<4> [331.341541] ? lock_release+0xd0/0x2b0
<4> [331.341546] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.341551] process_one_work+0x22e/0x740
<4> [331.341558] worker_thread+0x1e8/0x3d0
<4> [331.341561] ? __pfx_worker_thread+0x10/0x10
<4> [331.341564] kthread+0x10d/0x150
<4> [331.341567] ? __pfx_kthread+0x10/0x10
<4> [331.341570] ret_from_fork+0x3d4/0x480
<4> [331.341573] ? __pfx_kthread+0x10/0x10
<4> [331.341576] ret_from_fork_asm+0x1a/0x30
<4> [331.341582] </TASK>
<4> [331.341583] irq event stamp: 734607
<4> [331.341584] hardirqs last enabled at (734613): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.341587] hardirqs last disabled at (734618): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.341589] softirqs last enabled at (733460): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.341591] softirqs last disabled at (733453): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.341593] ---[ end trace 0000000000000000 ]---
<6> [331.342518] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [331.342618] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [331.342624] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [331.342677] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [331.342777] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [331.342879] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [331.343083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [331.343166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [331.343253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [331.343336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [331.343423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [331.343503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [331.343584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [331.343661] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [331.343753] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [331.343862] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [331.344866] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [331.355409] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [331.355665] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [331.356929] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [331.357005] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [331.357078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [331.357149] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [331.357221] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [331.357291] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [331.357362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [331.357440] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [331.357510] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [331.357580] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [331.357649] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [331.357718] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [331.357786] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [331.357855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [331.357923] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [331.357991] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [331.358060] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [331.358128] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [331.358195] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [331.358270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [331.358345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [331.358422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [331.358498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [331.358571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [331.358642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [331.358712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [331.358782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [331.358853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [331.358926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [331.358997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [331.359068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [331.359139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [331.359215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [331.359292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [331.359369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [331.359451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [331.359524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [331.359592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [331.359662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [331.359731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [331.359803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [331.359873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [331.359943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [331.360012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [331.360084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [331.360154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [331.360223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [331.360292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [331.360362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [331.360437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [331.360506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [331.360579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [331.360650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [331.360720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [331.360789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [331.360859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [331.360927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [331.360994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [331.361065] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [331.361184] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [331.361187] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16477, lrc_seqno=16477, guc_id=0, flags=0x73 in no process [-1]
<7> [331.361190] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.361246] ------------[ cut here ]------------
<4> [331.361248] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.361249] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/119
<4> [331.361318] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.361376] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.361384] CPU: 10 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.361387] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.361388] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.361389] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.361394] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.361475] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.361477] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246
<4> [331.361479] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.361480] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.361482] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.361483] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.361484] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.361486] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000
<4> [331.361487] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.361489] CR2: 00007a4ade8a0000 CR3: 0000000122f7e006 CR4: 0000000000f72ef0
<4> [331.361490] PKRU: 55555554
<4> [331.361492] Call Trace:
<4> [331.361493] <TASK>
<4> [331.361496] ? __pfx_lock_acquire+0x10/0x10
<4> [331.361502] ? lock_release+0xd0/0x2b0
<4> [331.361506] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.361512] process_one_work+0x22e/0x740
<4> [331.361519] worker_thread+0x1e8/0x3d0
<4> [331.361523] ? __pfx_worker_thread+0x10/0x10
<4> [331.361526] kthread+0x10d/0x150
<4> [331.361528] ? __pfx_kthread+0x10/0x10
<4> [331.361532] ret_from_fork+0x3d4/0x480
<4> [331.361535] ? __pfx_kthread+0x10/0x10
<4> [331.361537] ret_from_fork_asm+0x1a/0x30
<4> [331.361544] </TASK>
<4> [331.361545] irq event stamp: 737727
<4> [331.361546] hardirqs last enabled at (737733): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.361549] hardirqs last disabled at (737738): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.361551] softirqs last enabled at (736580): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.361553] softirqs last disabled at (736571): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.361555] ---[ end trace 0000000000000000 ]---
<7> [331.362884] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [331.363027] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [331.366956] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16485, lrc_seqno=16485, guc_id=0, flags=0x73 in no process [-1]
<7> [331.366960] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.367026] ------------[ cut here ]------------
<4> [331.367027] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.367028] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:1/119
<4> [331.367104] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.367163] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.367171] CPU: 6 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.367173] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.367175] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.367176] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.367181] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.367252] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.367254] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246
<4> [331.367256] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.367258] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.367259] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.367260] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.367261] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.367262] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000
<4> [331.367264] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.367265] CR2: 000072601fe8a000 CR3: 000000011422a003 CR4: 0000000000f72ef0
<4> [331.367267] PKRU: 55555554
<4> [331.367268] Call Trace:
<4> [331.367269] <TASK>
<4> [331.367273] ? __pfx_lock_acquire+0x10/0x10
<4> [331.367278] ? lock_release+0xd0/0x2b0
<4> [331.367283] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.367288] process_one_work+0x22e/0x740
<4> [331.367295] worker_thread+0x1e8/0x3d0
<4> [331.367299] ? __pfx_worker_thread+0x10/0x10
<4> [331.367302] kthread+0x10d/0x150
<4> [331.367304] ? __pfx_kthread+0x10/0x10
<4> [331.367307] ret_from_fork+0x3d4/0x480
<4> [331.367310] ? __pfx_kthread+0x10/0x10
<4> [331.367313] ret_from_fork_asm+0x1a/0x30
<4> [331.367320] </TASK>
<4> [331.367321] irq event stamp: 739025
<4> [331.367322] hardirqs last enabled at (739031): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.367324] hardirqs last disabled at (739036): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.367326] softirqs last enabled at (736580): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.367329] softirqs last disabled at (736571): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.367331] ---[ end trace 0000000000000000 ]---
<6> [331.367332] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [331.367407] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [331.367415] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [331.367956] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [331.368169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [331.368261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [331.368351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [331.368452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [331.368534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [331.368613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [331.368692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [331.368769] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [331.368862] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [331.368971] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [331.369979] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [331.380410] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [331.380668] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [331.381935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [331.382012] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [331.382085] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [331.382158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [331.382230] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [331.382301] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [331.382373] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [331.382461] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [331.382531] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [331.382601] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [331.382669] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [331.382738] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [331.382806] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [331.382872] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [331.382940] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [331.383008] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [331.383077] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [331.383146] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [331.383214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [331.383292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [331.383370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [331.383483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [331.383559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [331.383631] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [331.383702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [331.383770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [331.383839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [331.383912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [331.383987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [331.384061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [331.384134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [331.384207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [331.384285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [331.384362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [331.384453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [331.384527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [331.384599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [331.384669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [331.384738] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [331.384807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [331.384880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [331.384951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [331.385021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [331.385090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [331.385164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [331.385233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [331.385303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [331.385373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [331.385458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [331.385527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [331.385595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [331.385666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [331.385735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [331.385805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [331.385872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [331.385941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [331.386009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [331.386076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [331.386145] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [331.386266] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [331.386270] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16485, lrc_seqno=16485, guc_id=0, flags=0x73 in no process [-1]
<7> [331.386273] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.386330] ------------[ cut here ]------------
<4> [331.386331] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.386332] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#1: kworker/u64:5/204
<4> [331.386407] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.386470] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.386478] CPU: 1 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.386481] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.386482] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.386483] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.386488] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.386557] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.386558] RSP: 0018:ffffc9000161fca0 EFLAGS: 00010246
<4> [331.386560] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.386562] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.386563] RBP: ffffc9000161fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.386564] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.386565] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.386566] FS: 0000000000000000(0000) GS:ffff8888dad1b000(0000) knlGS:0000000000000000
<4> [331.386568] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.386569] CR2: 00005a61f83233c8 CR3: 000000011c043003 CR4: 0000000000f72ef0
<4> [331.386571] PKRU: 55555554
<4> [331.386572] Call Trace:
<4> [331.386573] <TASK>
<4> [331.386576] ? __pfx_lock_acquire+0x10/0x10
<4> [331.386582] ? lock_release+0xd0/0x2b0
<4> [331.386587] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.386592] process_one_work+0x22e/0x740
<4> [331.386599] worker_thread+0x1e8/0x3d0
<4> [331.386602] ? __pfx_worker_thread+0x10/0x10
<4> [331.386605] kthread+0x10d/0x150
<4> [331.386608] ? __pfx_kthread+0x10/0x10
<4> [331.386611] ret_from_fork+0x3d4/0x480
<4> [331.386614] ? __pfx_kthread+0x10/0x10
<4> [331.386617] ret_from_fork_asm+0x1a/0x30
<4> [331.386624] </TASK>
<4> [331.386625] irq event stamp: 1493553
<4> [331.386626] hardirqs last enabled at (1493559): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.386629] hardirqs last disabled at (1493564): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.386630] softirqs last enabled at (1492502): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.386633] softirqs last disabled at (1492495): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.386635] ---[ end trace 0000000000000000 ]---
<6> [331.386636] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [331.386703] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [331.386709] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [331.387115] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [331.387317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [331.387399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [331.387503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [331.387586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [331.387666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [331.387747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [331.387826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [331.387902] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [331.387994] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [331.388105] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [331.389112] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [331.399409] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [331.399665] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [331.400960] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [331.401038] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [331.401111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [331.401182] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [331.401256] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [331.401328] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [331.401399] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [331.401492] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [331.401566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [331.401636] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [331.401705] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [331.401774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [331.401843] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [331.401913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [331.401981] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [331.402050] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [331.402119] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [331.402189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [331.402257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [331.402335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [331.402419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [331.402493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [331.402566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [331.402636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [331.402707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [331.402777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [331.402845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [331.402918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [331.402990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [331.403061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [331.403132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [331.403203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [331.403278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [331.403353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [331.403436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [331.403511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [331.403584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [331.403655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [331.403726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [331.403793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [331.403865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [331.403936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [331.404005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [331.404073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [331.404146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [331.404214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [331.404284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [331.404350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [331.404430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [331.404502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [331.404572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [331.404645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [331.404715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [331.404783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [331.404853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [331.404924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [331.404992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [331.405061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [331.405131] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [331.405249] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [331.405253] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16485, lrc_seqno=16485, guc_id=0, flags=0x73 in no process [-1]
<7> [331.405255] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.405312] ------------[ cut here ]------------
<4> [331.405314] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.405315] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#1: kworker/u64:5/204
<4> [331.405384] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.405454] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.405462] CPU: 1 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.405465] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.405466] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.405467] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.405472] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.405540] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.405542] RSP: 0018:ffffc9000161fca0 EFLAGS: 00010246
<4> [331.405544] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.405545] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.405546] RBP: ffffc9000161fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.405547] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.405549] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.405550] FS: 0000000000000000(0000) GS:ffff8888dad1b000(0000) knlGS:0000000000000000
<4> [331.405551] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.405553] CR2: 00005a61f83233c8 CR3: 000000000344a005 CR4: 0000000000f72ef0
<4> [331.405554] PKRU: 55555554
<4> [331.405555] Call Trace:
<4> [331.405556] <TASK>
<4> [331.405560] ? __pfx_lock_acquire+0x10/0x10
<4> [331.405565] ? lock_release+0xd0/0x2b0
<4> [331.405570] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.405575] process_one_work+0x22e/0x740
<4> [331.405582] worker_thread+0x1e8/0x3d0
<4> [331.405585] ? __pfx_worker_thread+0x10/0x10
<4> [331.405588] kthread+0x10d/0x150
<4> [331.405590] ? __pfx_kthread+0x10/0x10
<4> [331.405594] ret_from_fork+0x3d4/0x480
<4> [331.405596] ? __pfx_kthread+0x10/0x10
<4> [331.405599] ret_from_fork_asm+0x1a/0x30
<4> [331.405606] </TASK>
<4> [331.405607] irq event stamp: 1496645
<4> [331.405608] hardirqs last enabled at (1496651): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.405610] hardirqs last disabled at (1496656): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.405612] softirqs last enabled at (1495492): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.405614] softirqs last disabled at (1495485): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.405616] ---[ end trace 0000000000000000 ]---
<7> [331.406675] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [331.406776] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [331.408469] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16486, lrc_seqno=16486, guc_id=0, flags=0x73 in no process [-1]
<7> [331.408472] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<7> [331.408504] xe 0000:03:00.0: [drm:drm_mode_addfb2] [FB:560]
<4> [331.408534] ------------[ cut here ]------------
<4> [331.408535] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.408536] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:9/208
<4> [331.408607] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.408666] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.408673] CPU: 2 UID: 0 PID: 208 Comm: kworker/u64:9 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.408676] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.408677] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.408678] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.408683] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.408753] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.408754] RSP: 0000:ffffc9000163fca0 EFLAGS: 00010246
<4> [331.408756] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.408758] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.408759] RBP: ffffc9000163fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.408760] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.408761] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.408762] FS: 0000000000000000(0000) GS:ffff8888dad9b000(0000) knlGS:0000000000000000
<4> [331.408764] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.408765] CR2: 00007a4ade889000 CR3: 000000000344a002 CR4: 0000000000f72ef0
<4> [331.408766] PKRU: 55555554
<4> [331.408768] Call Trace:
<4> [331.408769] <TASK>
<4> [331.408772] ? __pfx_lock_acquire+0x10/0x10
<4> [331.408777] ? lock_release+0xd0/0x2b0
<4> [331.408782] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.408788] process_one_work+0x22e/0x740
<4> [331.408794] worker_thread+0x1e8/0x3d0
<4> [331.408798] ? __pfx_worker_thread+0x10/0x10
<4> [331.408801] kthread+0x10d/0x150
<4> [331.408803] ? __pfx_kthread+0x10/0x10
<4> [331.408807] ret_from_fork+0x3d4/0x480
<4> [331.408809] ? __pfx_kthread+0x10/0x10
<4> [331.408812] ret_from_fork_asm+0x1a/0x30
<4> [331.408819] </TASK>
<4> [331.408820] irq event stamp: 1688477
<4> [331.408821] hardirqs last enabled at (1688483): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.408823] hardirqs last disabled at (1688488): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.408825] softirqs last enabled at (1687504): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.408827] softirqs last disabled at (1687499): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.408829] ---[ end trace 0000000000000000 ]---
<6> [331.408831] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [331.408899] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [331.408905] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [331.409078] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [331.409296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [331.409391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [331.409497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [331.409581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [331.409679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [331.409758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [331.409838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [331.409915] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [331.410007] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [331.410119] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [331.411126] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [331.421411] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [331.421668] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [331.422946] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [331.423024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [331.423097] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [331.423170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [331.423242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [331.423312] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [331.423383] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [331.423467] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [331.423538] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [331.423608] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [331.423675] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [331.423746] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [331.423816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [331.423886] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [331.423955] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [331.424023] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [331.424093] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [331.424162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [331.424231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [331.424309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [331.424386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [331.424473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [331.424547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [331.424618] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [331.424688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [331.424759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [331.424832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [331.424905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [331.424978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [331.425049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [331.425121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [331.425192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [331.425269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [331.425345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [331.425428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [331.425503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [331.425576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [331.425647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [331.425715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [331.425782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [331.425853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [331.425923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [331.425992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [331.426060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [331.426132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [331.426203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [331.426275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [331.426344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [331.426420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [331.426489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [331.426558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [331.426629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [331.426700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [331.426767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [331.426836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [331.426908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [331.426981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [331.427052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [331.427125] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [331.427243] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [331.427247] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16486, lrc_seqno=16486, guc_id=0, flags=0x73 in no process [-1]
<7> [331.427249] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.427306] ------------[ cut here ]------------
<4> [331.427307] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.427308] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:5/204
<4> [331.427377] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.427441] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.427449] CPU: 6 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.427451] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.427452] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.427454] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.427459] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.427527] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.427528] RSP: 0018:ffffc9000161fca0 EFLAGS: 00010246
<4> [331.427530] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.427532] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.427533] RBP: ffffc9000161fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.427534] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.427535] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.427536] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000
<4> [331.427538] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.427539] CR2: 000072601fe8a000 CR3: 000000011422a003 CR4: 0000000000f72ef0
<4> [331.427540] PKRU: 55555554
<4> [331.427541] Call Trace:
<4> [331.427542] <TASK>
<4> [331.427546] ? __pfx_lock_acquire+0x10/0x10
<4> [331.427551] ? lock_release+0xd0/0x2b0
<4> [331.427556] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.427561] process_one_work+0x22e/0x740
<4> [331.427568] worker_thread+0x1e8/0x3d0
<4> [331.427572] ? __pfx_worker_thread+0x10/0x10
<4> [331.427575] kthread+0x10d/0x150
<4> [331.427577] ? __pfx_kthread+0x10/0x10
<4> [331.427580] ret_from_fork+0x3d4/0x480
<4> [331.427583] ? __pfx_kthread+0x10/0x10
<4> [331.427586] ret_from_fork_asm+0x1a/0x30
<4> [331.427593] </TASK>
<4> [331.427594] irq event stamp: 1499939
<4> [331.427595] hardirqs last enabled at (1499945): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.427597] hardirqs last disabled at (1499950): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.427599] softirqs last enabled at (1498680): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.427601] softirqs last disabled at (1498675): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.427603] ---[ end trace 0000000000000000 ]---
<6> [331.427605] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [331.427672] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [331.427678] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [331.428084] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [331.428285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [331.428367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [331.428464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [331.428544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [331.428621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [331.428699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [331.428778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [331.428854] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [331.428946] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [331.429057] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [331.430061] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [331.440772] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [331.441021] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [331.442586] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [331.442682] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [331.442764] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [331.442844] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [331.442921] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [331.442997] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [331.443073] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [331.443146] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [331.443221] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [331.443294] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [331.443366] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [331.443453] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [331.443526] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [331.443599] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [331.443671] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [331.443744] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [331.443817] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [331.443890] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [331.443963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [331.444048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [331.444130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [331.444208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [331.444287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [331.444363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [331.444448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [331.444525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [331.444599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [331.444677] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [331.444755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [331.444832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [331.444908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [331.444985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [331.445067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [331.445148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [331.445230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [331.445308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [331.445385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [331.445470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [331.445544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [331.445621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [331.445700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [331.445777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [331.445852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [331.445925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [331.446003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [331.446078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [331.446152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [331.446225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [331.446299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [331.446372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [331.446452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [331.446528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [331.446602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [331.446674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [331.446747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [331.446822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [331.446894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [331.446967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [331.447043] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [331.447165] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [331.447170] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16486, lrc_seqno=16486, guc_id=0, flags=0x73 in no process [-1]
<7> [331.447172] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.447233] ------------[ cut here ]------------
<4> [331.447234] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.447236] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:5/204
<4> [331.447311] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.447370] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.447378] CPU: 10 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.447381] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.447382] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.447383] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.447388] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.447472] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.447474] RSP: 0018:ffffc9000161fca0 EFLAGS: 00010246
<4> [331.447476] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.447478] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.447479] RBP: ffffc9000161fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.447480] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.447482] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.447483] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000
<4> [331.447485] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.447486] CR2: 00007a4ade8a0000 CR3: 000000000344a002 CR4: 0000000000f72ef0
<4> [331.447488] PKRU: 55555554
<4> [331.447489] Call Trace:
<4> [331.447490] <TASK>
<4> [331.447494] ? __pfx_lock_acquire+0x10/0x10
<4> [331.447499] ? lock_release+0xd0/0x2b0
<4> [331.447504] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.447510] process_one_work+0x22e/0x740
<4> [331.447517] worker_thread+0x1e8/0x3d0
<4> [331.447520] ? __pfx_worker_thread+0x10/0x10
<4> [331.447523] kthread+0x10d/0x150
<4> [331.447526] ? __pfx_kthread+0x10/0x10
<4> [331.447529] ret_from_fork+0x3d4/0x480
<4> [331.447532] ? __pfx_kthread+0x10/0x10
<4> [331.447535] ret_from_fork_asm+0x1a/0x30
<4> [331.447542] </TASK>
<4> [331.447543] irq event stamp: 1503037
<4> [331.447544] hardirqs last enabled at (1503043): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.447547] hardirqs last disabled at (1503048): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.447549] softirqs last enabled at (1502012): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.447551] softirqs last disabled at (1502007): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.447553] ---[ end trace 0000000000000000 ]---
<7> [331.448645] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [331.448757] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [331.454671] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16495, lrc_seqno=16495, guc_id=0, flags=0x73 in no process [-1]
<7> [331.454676] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.454746] ------------[ cut here ]------------
<4> [331.454748] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.454749] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:1/119
<4> [331.454829] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.454888] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.454896] CPU: 10 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.454898] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.454900] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.454901] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.454906] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.454981] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.454982] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246
<4> [331.454985] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.454986] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.454987] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.454988] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.454989] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.454991] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000
<4> [331.454992] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.454993] CR2: 00007a4ade8a0000 CR3: 000000000344a002 CR4: 0000000000f72ef0
<4> [331.454995] PKRU: 55555554
<4> [331.454996] Call Trace:
<4> [331.454997] <TASK>
<4> [331.455001] ? __pfx_lock_acquire+0x10/0x10
<4> [331.455006] ? lock_release+0xd0/0x2b0
<4> [331.455011] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.455017] process_one_work+0x22e/0x740
<4> [331.455024] worker_thread+0x1e8/0x3d0
<4> [331.455027] ? __pfx_worker_thread+0x10/0x10
<4> [331.455030] kthread+0x10d/0x150
<4> [331.455033] ? __pfx_kthread+0x10/0x10
<4> [331.455036] ret_from_fork+0x3d4/0x480
<4> [331.455039] ? __pfx_kthread+0x10/0x10
<4> [331.455042] ret_from_fork_asm+0x1a/0x30
<4> [331.455049] </TASK>
<4> [331.455050] irq event stamp: 741125
<4> [331.455051] hardirqs last enabled at (741131): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.455053] hardirqs last disabled at (741136): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.455055] softirqs last enabled at (739718): [<ffffffff81338af3>] kernel_fpu_end+0x53/0x70
<4> [331.455057] softirqs last disabled at (739716): [<ffffffff81339204>] kernel_fpu_begin_mask+0xc4/0x120
<4> [331.455059] ---[ end trace 0000000000000000 ]---
<6> [331.455061] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [331.455134] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [331.455140] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [331.455554] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [331.455762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [331.455857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [331.455952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [331.456040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [331.456125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [331.456211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [331.456299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [331.456381] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [331.456489] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [331.456607] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [331.457616] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [331.467409] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [331.467669] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [331.468957] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [331.469042] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [331.469118] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [331.469194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [331.469268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [331.469341] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [331.469440] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [331.469512] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [331.469583] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [331.469652] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [331.469722] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [331.469790] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [331.469859] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [331.469928] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [331.469995] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [331.470064] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [331.470132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [331.470201] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [331.470270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [331.470349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [331.470434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [331.470507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [331.470580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [331.470652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [331.470726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [331.470797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [331.470867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [331.470939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [331.471011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [331.471083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [331.471155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [331.471228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [331.471304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [331.471381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [331.471468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [331.471542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [331.471615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [331.471685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [331.471754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [331.471822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [331.471893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [331.471962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [331.472032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [331.472101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [331.472174] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [331.472243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [331.472312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [331.472380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [331.472461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [331.472528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [331.472596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [331.472668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [331.472737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [331.472806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [331.472874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [331.472945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [331.473012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [331.473080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [331.473149] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [331.473272] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [331.473276] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16495, lrc_seqno=16495, guc_id=0, flags=0x73 in no process [-1]
<7> [331.473278] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.473335] ------------[ cut here ]------------
<4> [331.473336] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.473337] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:1/119
<4> [331.473413] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.473473] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.473481] CPU: 6 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.473483] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.473484] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.473486] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.473491] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.473559] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.473561] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246
<4> [331.473563] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.473564] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.473565] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.473566] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.473567] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.473569] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000
<4> [331.473570] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.473571] CR2: 000072601fe8a000 CR3: 0000000122f7e004 CR4: 0000000000f72ef0
<4> [331.473573] PKRU: 55555554
<4> [331.473574] Call Trace:
<4> [331.473575] <TASK>
<4> [331.473578] ? __pfx_lock_acquire+0x10/0x10
<4> [331.473584] ? lock_release+0xd0/0x2b0
<4> [331.473589] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.473594] process_one_work+0x22e/0x740
<4> [331.473601] worker_thread+0x1e8/0x3d0
<4> [331.473604] ? __pfx_worker_thread+0x10/0x10
<4> [331.473607] kthread+0x10d/0x150
<4> [331.473610] ? __pfx_kthread+0x10/0x10
<4> [331.473613] ret_from_fork+0x3d4/0x480
<4> [331.473616] ? __pfx_kthread+0x10/0x10
<4> [331.473619] ret_from_fork_asm+0x1a/0x30
<4> [331.473625] </TASK>
<4> [331.473626] irq event stamp: 744307
<4> [331.473627] hardirqs last enabled at (744313): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.473630] hardirqs last disabled at (744318): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.473632] softirqs last enabled at (743154): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.473634] softirqs last disabled at (743147): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.473636] ---[ end trace 0000000000000000 ]---
<6> [331.473637] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [331.473704] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [331.473710] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [331.474118] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [331.474319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [331.474413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [331.474500] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [331.474580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [331.474659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [331.474736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [331.474814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [331.474888] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [331.474981] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [331.475089] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [331.476095] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [331.486408] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [331.486663] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [331.488039] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [331.488167] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [331.488285] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [331.488411] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [331.488531] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [331.488648] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [331.488764] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [331.488880] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [331.488997] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [331.489113] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [331.489229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [331.489345] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [331.489468] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [331.489586] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [331.489703] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [331.489819] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [331.489935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [331.490051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [331.490167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [331.490290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [331.490416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [331.490538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [331.490659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [331.490779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [331.490897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [331.491017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [331.491135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [331.491257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [331.491381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [331.491507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [331.491630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [331.491752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [331.491880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [331.492007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [331.492134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [331.492259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [331.492383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [331.492508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [331.492629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [331.492749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [331.492872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [331.492993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [331.493113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [331.493233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [331.493357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [331.493481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [331.493602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [331.493721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [331.493843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [331.493961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [331.494080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [331.494203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [331.494324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [331.494448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [331.494568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [331.494689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [331.494808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [331.494927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [331.495051] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [331.495218] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [331.495224] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16495, lrc_seqno=16495, guc_id=0, flags=0x73 in no process [-1]
<7> [331.495228] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.495326] ------------[ cut here ]------------
<4> [331.495328] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.495330] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#12: kworker/u64:1/119
<4> [331.495444] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.495530] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.495541] CPU: 12 UID: 0 PID: 119 Comm: kworker/u64:1 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.495544] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.495546] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.495548] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.495555] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.495663] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.495665] RSP: 0018:ffffc90000553ca0 EFLAGS: 00010246
<4> [331.495668] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.495670] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.495672] RBP: ffffc90000553db0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.495673] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.495675] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.495677] FS: 0000000000000000(0000) GS:ffff8888db29b000(0000) knlGS:0000000000000000
<4> [331.495679] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.495681] CR2: 000072601fe7f000 CR3: 000000000344a003 CR4: 0000000000f72ef0
<4> [331.495683] PKRU: 55555554
<4> [331.495684] Call Trace:
<4> [331.495686] <TASK>
<4> [331.495692] ? __pfx_lock_acquire+0x10/0x10
<4> [331.495700] ? lock_release+0xd0/0x2b0
<4> [331.495708] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.495717] process_one_work+0x22e/0x740
<4> [331.495728] worker_thread+0x1e8/0x3d0
<4> [331.495733] ? __pfx_worker_thread+0x10/0x10
<4> [331.495737] kthread+0x10d/0x150
<4> [331.495741] ? __pfx_kthread+0x10/0x10
<4> [331.495746] ret_from_fork+0x3d4/0x480
<4> [331.495749] ? __pfx_kthread+0x10/0x10
<4> [331.495753] ret_from_fork_asm+0x1a/0x30
<4> [331.495765] </TASK>
<4> [331.495766] irq event stamp: 747439
<4> [331.495768] hardirqs last enabled at (747445): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.495771] hardirqs last disabled at (747450): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.495774] softirqs last enabled at (746410): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.495777] softirqs last disabled at (746403): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.495779] ---[ end trace 0000000000000000 ]---
<7> [331.497548] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [331.497712] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [331.498051] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16496, lrc_seqno=16496, guc_id=0, flags=0x73 in no process [-1]
<7> [331.498055] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.498183] ------------[ cut here ]------------
<4> [331.498184] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.498186] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:5/204
<4> [331.498260] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.498318] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.498326] CPU: 10 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.498328] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.498329] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.498331] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.498336] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.498412] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.498414] RSP: 0018:ffffc9000161fca0 EFLAGS: 00010246
<4> [331.498416] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.498418] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.498419] RBP: ffffc9000161fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.498420] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.498422] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.498423] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000
<4> [331.498425] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.498426] CR2: 00007a4ade8a0000 CR3: 0000000122f7e006 CR4: 0000000000f72ef0
<4> [331.498428] PKRU: 55555554
<4> [331.498429] Call Trace:
<4> [331.498430] <TASK>
<4> [331.498434] ? __pfx_lock_acquire+0x10/0x10
<4> [331.498439] ? lock_release+0xd0/0x2b0
<4> [331.498444] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.498450] process_one_work+0x22e/0x740
<4> [331.498457] worker_thread+0x1e8/0x3d0
<4> [331.498460] ? __pfx_worker_thread+0x10/0x10
<4> [331.498463] kthread+0x10d/0x150
<4> [331.498466] ? __pfx_kthread+0x10/0x10
<4> [331.498469] ret_from_fork+0x3d4/0x480
<4> [331.498472] ? __pfx_kthread+0x10/0x10
<4> [331.498475] ret_from_fork_asm+0x1a/0x30
<4> [331.498481] </TASK>
<4> [331.498483] irq event stamp: 1506377
<4> [331.498484] hardirqs last enabled at (1506383): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.498487] hardirqs last disabled at (1506388): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.498489] softirqs last enabled at (1505372): [<ffffffff81338af3>] kernel_fpu_end+0x53/0x70
<4> [331.498491] softirqs last disabled at (1505370): [<ffffffff81339204>] kernel_fpu_begin_mask+0xc4/0x120
<4> [331.498493] ---[ end trace 0000000000000000 ]---
<6> [331.498495] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [331.498565] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [331.498571] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [331.498967] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [331.499214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [331.499308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [331.499398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [331.499497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [331.499610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [331.499691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [331.499773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [331.499850] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [331.499941] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [331.500054] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [331.501061] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [331.511407] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [331.511664] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [331.512934] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [331.513009] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [331.513082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [331.513154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [331.513225] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [331.513296] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [331.513367] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [331.513452] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [331.513521] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [331.513591] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [331.513661] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [331.513730] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [331.513798] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [331.513867] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [331.513934] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [331.514002] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [331.514067] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [331.514132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [331.514200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [331.514276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [331.514352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [331.514433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [331.514508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [331.514580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [331.514650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [331.514720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [331.514790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [331.514862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [331.514934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [331.515006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [331.515078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [331.515149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [331.515225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [331.515301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [331.515377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [331.515457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [331.515529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [331.515599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [331.515668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [331.515736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [331.515808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [331.515881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [331.515952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [331.516021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [331.516095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [331.516164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [331.516236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [331.516307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [331.516379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [331.516455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [331.516524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [331.516596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [331.516666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [331.516736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [331.516805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [331.516877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [331.516947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [331.517015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [331.517088] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [331.517206] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [331.517210] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16496, lrc_seqno=16496, guc_id=0, flags=0x73 in no process [-1]
<7> [331.517212] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.517269] ------------[ cut here ]------------
<4> [331.517270] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.517271] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:5/204
<4> [331.517340] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.517398] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.517409] CPU: 10 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.517412] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.517413] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.517414] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.517420] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.517488] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.517489] RSP: 0018:ffffc9000161fca0 EFLAGS: 00010246
<4> [331.517491] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.517492] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.517494] RBP: ffffc9000161fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.517495] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.517496] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.517497] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000
<4> [331.517499] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.517500] CR2: 00007a4ade8a0000 CR3: 0000000122f7e006 CR4: 0000000000f72ef0
<4> [331.517501] PKRU: 55555554
<4> [331.517502] Call Trace:
<4> [331.517503] <TASK>
<4> [331.517507] ? __pfx_lock_acquire+0x10/0x10
<4> [331.517512] ? lock_release+0xd0/0x2b0
<4> [331.517517] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.517522] process_one_work+0x22e/0x740
<4> [331.517529] worker_thread+0x1e8/0x3d0
<4> [331.517532] ? __pfx_worker_thread+0x10/0x10
<4> [331.517535] kthread+0x10d/0x150
<4> [331.517538] ? __pfx_kthread+0x10/0x10
<4> [331.517541] ret_from_fork+0x3d4/0x480
<4> [331.517543] ? __pfx_kthread+0x10/0x10
<4> [331.517546] ret_from_fork_asm+0x1a/0x30
<4> [331.517553] </TASK>
<4> [331.517554] irq event stamp: 1509471
<4> [331.517555] hardirqs last enabled at (1509477): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.517558] hardirqs last disabled at (1509482): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.517559] softirqs last enabled at (1508324): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.517562] softirqs last disabled at (1508315): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.517564] ---[ end trace 0000000000000000 ]---
<6> [331.517565] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [331.517633] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [331.517639] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [331.517811] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [331.518013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [331.518099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [331.518186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [331.518268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [331.518351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [331.518437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [331.518517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [331.518594] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [331.518686] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [331.518797] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [331.519799] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [331.530408] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [331.530664] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [331.531850] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [331.531927] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [331.531999] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [331.532071] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [331.532141] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [331.532211] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [331.532280] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [331.532350] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [331.532427] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [331.532497] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [331.532566] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [331.532634] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [331.532703] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [331.532774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [331.532843] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [331.532911] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [331.532977] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [331.533045] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [331.533113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [331.533191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [331.533267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [331.533340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [331.533419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [331.533493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [331.533565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [331.533636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [331.533706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [331.533779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [331.533852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [331.533923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [331.533995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [331.534064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [331.534141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [331.534219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [331.534296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [331.534371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [331.534451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [331.534520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [331.534590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [331.534658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [331.534731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [331.534802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [331.534875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [331.534944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [331.535016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [331.535083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [331.535152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [331.535219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [331.535289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [331.535357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [331.535428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [331.535499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [331.535568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [331.535638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [331.535706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [331.535775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [331.535841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [331.535907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [331.535976] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [331.536094] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [331.536098] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16496, lrc_seqno=16496, guc_id=0, flags=0x73 in no process [-1]
<7> [331.536100] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.536156] ------------[ cut here ]------------
<4> [331.536157] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.536158] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:5/204
<4> [331.536228] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.536286] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.536293] CPU: 10 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.536296] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.536297] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.536298] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.536303] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.536369] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.536370] RSP: 0018:ffffc9000161fca0 EFLAGS: 00010246
<4> [331.536372] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.536374] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.536375] RBP: ffffc9000161fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.536376] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.536377] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.536378] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000
<4> [331.536380] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.536381] CR2: 00007a4ade8a0000 CR3: 0000000122f7e006 CR4: 0000000000f72ef0
<4> [331.536382] PKRU: 55555554
<4> [331.536383] Call Trace:
<4> [331.536384] <TASK>
<4> [331.536388] ? __pfx_lock_acquire+0x10/0x10
<4> [331.536393] ? lock_release+0xd0/0x2b0
<4> [331.536398] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.536406] process_one_work+0x22e/0x740
<4> [331.536413] worker_thread+0x1e8/0x3d0
<4> [331.536416] ? __pfx_worker_thread+0x10/0x10
<4> [331.536419] kthread+0x10d/0x150
<4> [331.536422] ? __pfx_kthread+0x10/0x10
<4> [331.536425] ret_from_fork+0x3d4/0x480
<4> [331.536428] ? __pfx_kthread+0x10/0x10
<4> [331.536431] ret_from_fork_asm+0x1a/0x30
<4> [331.536438] </TASK>
<4> [331.536439] irq event stamp: 1512571
<4> [331.536440] hardirqs last enabled at (1512577): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.536443] hardirqs last disabled at (1512582): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.536445] softirqs last enabled at (1511430): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.536447] softirqs last disabled at (1511421): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.536449] ---[ end trace 0000000000000000 ]---
<7> [331.537504] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [331.537604] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [331.542319] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16504, lrc_seqno=16504, guc_id=0, flags=0x73 in no process [-1]
<7> [331.542321] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.542381] ------------[ cut here ]------------
<4> [331.542382] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.542383] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:5/204
<4> [331.542466] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.542525] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.542532] CPU: 10 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.542535] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.542536] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.542537] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.542541] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.542610] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.542611] RSP: 0018:ffffc9000161fca0 EFLAGS: 00010246
<4> [331.542613] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.542614] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.542615] RBP: ffffc9000161fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.542617] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.542618] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.542619] FS: 0000000000000000(0000) GS:ffff8888db19b000(0000) knlGS:0000000000000000
<4> [331.542620] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.542621] CR2: 00007a4ade8a0000 CR3: 0000000122f7e006 CR4: 0000000000f72ef0
<4> [331.542623] PKRU: 55555554
<4> [331.542624] Call Trace:
<4> [331.542625] <TASK>
<4> [331.542628] ? __pfx_lock_acquire+0x10/0x10
<4> [331.542633] ? lock_release+0xd0/0x2b0
<4> [331.542638] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.542643] process_one_work+0x22e/0x740
<4> [331.542650] worker_thread+0x1e8/0x3d0
<4> [331.542654] ? __pfx_worker_thread+0x10/0x10
<4> [331.542657] kthread+0x10d/0x150
<4> [331.542659] ? __pfx_kthread+0x10/0x10
<4> [331.542662] ret_from_fork+0x3d4/0x480
<4> [331.542665] ? __pfx_kthread+0x10/0x10
<4> [331.542668] ret_from_fork_asm+0x1a/0x30
<4> [331.542675] </TASK>
<4> [331.542676] irq event stamp: 1513639
<4> [331.542677] hardirqs last enabled at (1513645): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.542680] hardirqs last disabled at (1513650): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.542682] softirqs last enabled at (1512866): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.542684] softirqs last disabled at (1512853): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.542686] ---[ end trace 0000000000000000 ]---
<6> [331.542687] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [331.542754] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [331.542760] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [331.543171] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [331.543372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [331.543467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [331.543555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [331.543636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [331.543715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [331.543793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [331.543869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [331.543945] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [331.544036] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [331.544147] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [331.545150] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [331.555407] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [331.555666] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [331.556914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [331.557000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [331.557076] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [331.557151] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [331.557224] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [331.557295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [331.557365] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [331.557448] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [331.557518] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [331.557587] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [331.557656] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [331.557726] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [331.557794] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [331.557864] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [331.557933] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [331.558001] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [331.558070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [331.558140] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [331.558210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [331.558288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [331.558366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [331.558451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [331.558525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [331.558599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [331.558672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [331.558744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [331.558815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [331.558889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [331.558960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [331.559028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [331.559101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [331.559173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [331.559250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [331.559327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [331.559408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [331.559483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [331.559556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [331.559627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [331.559697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [331.559766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [331.559838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [331.559907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [331.559978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [331.560047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [331.560119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [331.560190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [331.560259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [331.560326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [331.560396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [331.560481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [331.560550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [331.560622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [331.560691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [331.560760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [331.560829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [331.560899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [331.560967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [331.561034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [331.561106] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [331.561222] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [331.561226] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16504, lrc_seqno=16504, guc_id=0, flags=0x73 in no process [-1]
<7> [331.561228] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.561285] ------------[ cut here ]------------
<4> [331.561286] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.561287] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:5/204
<4> [331.561356] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.561421] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.561429] CPU: 6 UID: 0 PID: 204 Comm: kworker/u64:5 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.561432] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.561433] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.561434] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.561439] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.561507] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.561509] RSP: 0018:ffffc9000161fca0 EFLAGS: 00010246
<4> [331.561511] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.561512] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.561513] RBP: ffffc9000161fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.561514] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.561515] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.561517] FS: 0000000000000000(0000) GS:ffff8888daf9b000(0000) knlGS:0000000000000000
<4> [331.561518] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.561519] CR2: 000072601fe8a000 CR3: 000000000344a005 CR4: 0000000000f72ef0
<4> [331.561521] PKRU: 55555554
<4> [331.561522] Call Trace:
<4> [331.561523] <TASK>
<4> [331.561526] ? __pfx_lock_acquire+0x10/0x10
<4> [331.561532] ? lock_release+0xd0/0x2b0
<4> [331.561536] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.561542] process_one_work+0x22e/0x740
<4> [331.561548] worker_thread+0x1e8/0x3d0
<4> [331.561552] ? __pfx_worker_thread+0x10/0x10
<4> [331.561555] kthread+0x10d/0x150
<4> [331.561557] ? __pfx_kthread+0x10/0x10
<4> [331.561561] ret_from_fork+0x3d4/0x480
<4> [331.561563] ? __pfx_kthread+0x10/0x10
<4> [331.561566] ret_from_fork_asm+0x1a/0x30
<4> [331.561573] </TASK>
<4> [331.561574] irq event stamp: 1516729
<4> [331.561576] hardirqs last enabled at (1516735): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.561578] hardirqs last disabled at (1516740): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.561580] softirqs last enabled at (1515788): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.561582] softirqs last disabled at (1515783): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.561584] ---[ end trace 0000000000000000 ]---
<6> [331.561586] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [331.561653] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [331.561659] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [331.562942] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [331.563045] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [331.563149] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [331.563355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [331.563455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [331.563545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [331.563628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x55555440
<7> [331.563709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [331.563789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [331.563868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [331.563945] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [331.564039] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [331.564147] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [331.565153] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [331.575407] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [331.575665] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [331.576948] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [331.577025] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [331.577098] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [331.577170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [331.577243] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [331.577314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [331.577384] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [331.577467] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [331.577537] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [331.577606] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [331.577675] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [331.577742] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [331.577810] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [331.577878] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [331.577955] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [331.578024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [331.578093] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [331.578162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [331.578232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [331.578309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [331.578387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [331.578484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [331.578560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [331.578632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [331.578702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [331.578773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [331.578843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [331.578917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [331.578991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [331.579064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [331.579136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [331.579208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [331.579287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [331.579364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [331.579454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [331.579530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [331.579603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [331.579674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [331.579744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [331.579813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [331.579886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [331.579955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [331.580026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [331.580095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [331.580168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [331.580238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [331.580308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [331.580376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [331.580455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [331.580524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [331.580594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [331.580667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [331.580739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [331.580810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [331.580880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [331.580951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [331.581019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [331.581087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [331.581160] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [331.581279] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [331.581283] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=16504, lrc_seqno=16504, guc_id=0, flags=0x73 in no process [-1]
<7> [331.581285] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [331.581343] ------------[ cut here ]------------
<4> [331.581344] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [331.581345] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1612 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:9/208
<4> [331.581418] Modules linked in: xe_vfio_pci vfio_pci_core vfio_iommu_type1 vfio iommufd snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common cmdlinepart intel_tcc_cooling x86_pkg_temp_thermal spi_nor intel_powerclamp mtd hid_generic eeepc_wmi asus_wmi mei_pxp mei_hdcp sparse_keymap coretemp platform_profile wmi_bmof kvm_intel usbhid snd_intel_dspcfg kvm hid snd_hda_codec irqbypass snd_hda_core snd_hwdep ghash_clmulni_intel aesni_intel r8169 snd_pcm rapl intel_cstate spi_intel_pci snd_timer binfmt_misc i2c_i801 spi_intel snd video i2c_mux realtek i2c_smbus soundcore mei_me idma64 mei intel_pmc_core pmt_telemetry nls_iso8859_1 pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi acpi_pad acpi_tad intel_vsec
<4> [331.581478] dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: xe_live_test]
<4> [331.581485] CPU: 2 UID: 0 PID: 208 Comm: kworker/u64:9 Tainted: G S U W 7.0.0-rc1-lgci-xe-xe-4622-50b03c02e68b265fb-debug+ #1 PREEMPT(lazy)
<4> [331.581488] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [331.581489] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [331.581491] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [331.581495] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [331.581563] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 b6 3a 5e e1 48 89 c6 48 8d 3d ac b2 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [331.581565] RSP: 0000:ffffc9000163fca0 EFLAGS: 00010246
<4> [331.581567] RAX: ffffffffa11fa37f RBX: 0000000000000000 RCX: 0000000000000000
<4> [331.581568] RDX: ffff888104aaa190 RSI: ffffffffa11fa37f RDI: ffffffffa1003d60
<4> [331.581570] RBP: ffffc9000163fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [331.581571] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [331.581572] R13: ffff888104aaa190 R14: ffff88816a10a018 R15: 00000000ffffffc2
<4> [331.581573] FS: 0000000000000000(0000) GS:ffff8888dad9b000(0000) knlGS:0000000000000000
<4> [331.581575] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [331.581576] CR2: 00007a4ade889000 CR3: 000000000344a002 CR4: 0000000000f72ef0
<4> [331.581577] PKRU: 55555554
<4> [331.581578] Call Trace:
<4> [331.581579] <TASK>
<4> [331.581583] ? __pfx_lock_acquire+0x10/0x10
<4> [331.581588] ? lock_release+0xd0/0x2b0
<4> [331.581593] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [331.581598] process_one_work+0x22e/0x740
<4> [331.581605] worker_thread+0x1e8/0x3d0
<4> [331.581608] ? __pfx_worker_thread+0x10/0x10
<4> [331.581611] kthread+0x10d/0x150
<4> [331.581614] ? __pfx_kthread+0x10/0x10
<4> [331.581617] ret_from_fork+0x3d4/0x480
<4> [331.581620] ? __pfx_kthread+0x10/0x10
<4> [331.581623] ret_from_fork_asm+0x1a/0x30
<4> [331.581629] </TASK>
<4> [331.581630] irq event stamp: 1692173
<4> [331.581631] hardirqs last enabled at (1692179): [<ffffffff814a85a9>] __up_console_sem+0x79/0xa0
<4> [331.581634] hardirqs last disabled at (1692184): [<ffffffff814a858e>] __up_console_sem+0x5e/0xa0
<4> [331.581636] softirqs last enabled at (1691226): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.581638] softirqs last disabled at (1691219): [<ffffffff813cfccf>] __irq_exit_rcu+0x13f/0x160
<4> [331.581639] ---[ end trace 0000000000000000 ]---
<7> [331.582761] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [331.582866] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [331.583926] xe 0000:03:00.0: [drm:intel_dp_compute_config_limits [xe]] [ENCODER:525:DDI TC2/PHY G][CRTC:386:pipe C] DP link limits: pixel clock 148500 kHz DSC off max lanes 4 max rate 540000 max pipe_bpp 36 min link_bpp 18.0000 max link_bpp 36.0000
<7> [331.584040] xe 0000:03:00.0: [drm:intel_dp_compute_link_config [xe]] DP lane count 4 clock 270000 bpp input 36 compressed 0.0000 HDR no link rate required 668250 available 1080000
<7> [331.584146] xe 0000:03:00.0: [drm:intel_atomic_check [xe]] [CRTC:386:pipe C] hw max bpp: 36, pipe bpp: 36, dithering: 0
<7> [331.584250] xe 0000:03:00.0: [drm:intel_ddi_compute_config_late [xe]] [ENCODER:525:DDI TC2/PHY G] [CRTC:386:pipe C]
<7> [331.584353] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.enable (expected no, found yes)
<7> [331.584464] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.active (expected no, found yes)
<7> [331.584561] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in cpu_transcoder (expected -1, found 2)
<7> [331.584656] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in lane_count (expected 0, found 4)
<7> [331.584747] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in dp_m_n (expected tu 0 data 0/0 link 0/0, found tu 64, data 5190451/8388608 link 288358/524288)
<7> [331.584839] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in output_types (expected 0x00000000, found 0x00000080)
<7> [331.584932] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in framestart_delay (expected 0, found 1)
<7> [331.585022] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.pipe_mode.crtc_hdisplay (expected 0, found 1920)
<7> [331.585113] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.pipe_mode.crtc_htotal (expected 0, found 2200)
<7> [331.585202] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.pipe_mode.crtc_hblank_start (expected 0, found 1920)
<7> [331.585290] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.pipe_mode.crtc_hblank_end (expected 0, found 2200)
<7> [331.585379] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.pipe_mode.crtc_hsync_start (expected 0, found 2008)
<7> [331.585488] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.pipe_mode.crtc_hsync_end (expected 0, found 2052)
<7> [331.585580] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.pipe_mode.crtc_vdisplay (expected 0, found 1080)
<7> [331.585670] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.pipe_mode.crtc_vblank_start (expected 0, found 1080)
<7> [331.585760] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.pipe_mode.crtc_vsync_start (expected 0, found 1084)
<7> [331.585849] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.pipe_mode.crtc_vsync_end (expected 0, found 1089)
<7> [331.585938] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.pipe_mode.crtc_vtotal (expected 0, found 1125)
<7> [331.586027] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.pipe_mode.crtc_vblank_end (expected 0, found 1125)
<7> [331.586116] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_hdisplay (expected 0, found 1920)
<7> [331.586205] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_htotal (expected 0, found 2200)
<7> [331.586294] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_hblank_start (expected 0, found 1920)
<7> [331.586383] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_hblank_end (expected 0, found 2200)
<7> [331.586484] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_hsync_start (expected 0, found 2008)
<7> [331.586573] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_hsync_end (expected 0, found 2052)
<7> [331.586667] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_vdisplay (expected 0, found 1080)
<7> [331.586759] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_vblank_start (expected 0, found 1080)
<7> [331.586847] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_vsync_start (expected 0, found 1084)
<7> [331.586934] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_vsync_end (expected 0, found 1089)
<7> [331.587023] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_vtotal (expected 0, found 1125)
<7> [331.587110] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_vblank_end (expected 0, found 1125)
<7> [331.587199] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in pixel_multiplier (expected 0, found 1)
<7> [331.587287] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.adjusted_mode.flags (1) (expected 0, found 1)
<7> [331.587374] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.adjusted_mode.flags (4) (expected 0, found 4)
<7> [331.587472] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in enhanced_framing (expected no, found yes)
<7> [331.587560] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in dpll_hw_state
<7> [331.587648] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] expected:
<7> [331.587735] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] cx0pll_hw_state: lane_count: 0, ssc_enabled: no, use_c10: no, tbt_mode: no
<7> [331.587823] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] c20pll_hw_state:
<7> [331.587910] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] tx[0] = 0x0000, tx[1] = 0x0000, tx[2] = 0x0000
<7> [331.587997] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] cmn[0] = 0x0000, cmn[1] = 0x0000, cmn[2] = 0x0000, cmn[3] = 0x0000
<7> [331.588081] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mplla[0] = 0x0000
<7> [331.588167] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mplla[1] = 0x0000
<7> [331.588251] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mplla[2] = 0x0000
<7> [331.588338] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mplla[3] = 0x0000
<7> [331.588431] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mplla[4] = 0x0000
<7> [331.588518] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mplla[5] = 0x0000
<7> [331.588604] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mplla[6] = 0x0000
<7> [331.588692] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mplla[7] = 0x0000
<7> [331.588780] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mplla[8] = 0x0000
<7> [331.588867] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mplla[9] = 0x0000
<7> [331.588952] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[10] = 0x0000
<7> [331.589039] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] vdr: custom width: 0x00, serdes rate: 0x00, hdmi rate: 0x00
<7> [331.589125] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] found:
<7> [331.589212] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] cx0pll_hw_state: lane_count: 4, ssc_enabled: no, use_c10: no, tbt_mode: no
<7> [331.589300] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] c20pll_hw_state:
<7> [331.589386] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] tx[0] = 0xbe88, tx[1] = 0x4800, tx[2] = 0x0000
<7> [331.589486] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] cmn[0] = 0x0500, cmn[1] = 0x0005, cmn[2] = 0x0000, cmn[3] = 0x0000
<7> [331.589573] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[0] = 0x308c
<7> [331.589660] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[1] = 0x2110
<7> [331.589747] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[2] = 0xcc9c
<7> [331.589833] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[3] = 0xbfc1
<7> [331.589918] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[4] = 0x4b9a
<7> [331.590002] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[5] = 0x3f81
<7> [331.590089] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[6] = 0x2000
<7> [331.590177] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[7] = 0x0001
<7> [331.590262] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[8] = 0x5000
<7> [331.590348] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[9] = 0x0000
<7> [331.590444] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[10] = 0x0000
<7> [331.590531] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] vdr: custom width: 0x00, serdes rate: 0x42, hdmi rate: 0x00
<7> [331.590616] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in pipe_bpp (expected 0, found 36)
<7> [331.590705] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.pipe_mode.crtc_clock (expected 0, found 148500)
<7> [331.590791] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_clock (expected 0, found 148500)
<7> [331.590875] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in port_clock (expected 0, found 270000)
<7> [331.590961] xe 0000:03:00.0: [drm:intel_atomic_check [xe]] [CRTC:386:pipe C] fastset requirement not met, forcing full modeset
<7> [331.591187] xe 0000:03:00.0: [drm:intel_dp_compute_config_limits [xe]] [ENCODER:525:DDI TC2/PHY G][CRTC:386:pipe C] DP link limits: pixel clock 148500 kHz DSC off max lanes 4 max rate 540000 max pipe_bpp 36 min link_bpp 18.0000 max link_bpp 36.0000
<7> [331.591284] xe 0000:03:00.0: [drm:intel_dp_compute_link_config [xe]] DP lane count 4 clock 270000 bpp input 36 compressed 0.0000 HDR no link rate required 668250 available 1080000
<7> [331.591379] xe 0000:03:00.0: [drm:intel_atomic_check [xe]] [CRTC:386:pipe C] hw max bpp: 36, pipe bpp: 36, dithering: 0
<7> [331.591485] xe 0000:03:00.0: [drm:intel_ddi_compute_config_late [xe]] [ENCODER:525:DDI TC2/PHY G] [CRTC:386:pipe C]
<7> [331.591584] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.enable (expected no, found yes)
<7> [331.591679] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.active (expected no, found yes)
<7> [331.591770] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in cpu_transcoder (expected -1, found 2)
<7> [331.591860] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in lane_count (expected 0, found 4)
<7> [331.591948] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in dp_m_n (expected tu 0 data 0/0 link 0/0, found tu 64, data 5190451/8388608 link 288358/524288)
<7> [331.592038] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in output_types (expected 0x00000000, found 0x00000080)
<7> [331.592128] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in framestart_delay (expected 0, found 1)
<7> [331.592215] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.pipe_mode.crtc_hdisplay (expected 0, found 1920)
<7> [331.592304] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.pipe_mode.crtc_htotal (expected 0, found 2200)
<7> [331.592388] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.pipe_mode.crtc_hblank_start (expected 0, found 1920)
<7> [331.592529] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.pipe_mode.crtc_hblank_end (expected 0, found 2200)
<7> [331.592619] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.pipe_mode.crtc_hsync_start (expected 0, found 2008)
<7> [331.592708] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.pipe_mode.crtc_hsync_end (expected 0, found 2052)
<7> [331.592796] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.pipe_mode.crtc_vdisplay (expected 0, found 1080)
<7> [331.592884] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.pipe_mode.crtc_vblank_start (expected 0, found 1080)
<7> [331.592971] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.pipe_mode.crtc_vsync_start (expected 0, found 1084)
<7> [331.593059] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.pipe_mode.crtc_vsync_end (expected 0, found 1089)
<7> [331.593145] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.pipe_mode.crtc_vtotal (expected 0, found 1125)
<7> [331.593232] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.pipe_mode.crtc_vblank_end (expected 0, found 1125)
<7> [331.593320] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_hdisplay (expected 0, found 1920)
<7> [331.593413] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_htotal (expected 0, found 2200)
<7> [331.593500] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_hblank_start (expected 0, found 1920)
<7> [331.593588] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_hblank_end (expected 0, found 2200)
<7> [331.593676] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_hsync_start (expected 0, found 2008)
<7> [331.593763] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_hsync_end (expected 0, found 2052)
<7> [331.593847] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_vdisplay (expected 0, found 1080)
<7> [331.593934] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_vblank_start (expected 0, found 1080)
<7> [331.594022] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_vsync_start (expected 0, found 1084)
<7> [331.594106] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_vsync_end (expected 0, found 1089)
<7> [331.594194] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_vtotal (expected 0, found 1125)
<7> [331.594281] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_vblank_end (expected 0, found 1125)
<7> [331.594372] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in pixel_multiplier (expected 0, found 1)
<7> [331.594480] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.adjusted_mode.flags (1) (expected 0, found 1)
<7> [331.594570] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.adjusted_mode.flags (4) (expected 0, found 4)
<7> [331.594659] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in enhanced_framing (expected no, found yes)
<7> [331.594747] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in dpll_hw_state
<7> [331.594834] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] expected:
<7> [331.594919] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] cx0pll_hw_state: lane_count: 0, ssc_enabled: no, use_c10: no, tbt_mode: no
<7> [331.595006] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] c20pll_hw_state:
<7> [331.595090] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] tx[0] = 0x0000, tx[1] = 0x0000, tx[2] = 0x0000
<7> [331.595177] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] cmn[0] = 0x0000, cmn[1] = 0x0000, cmn[2] = 0x0000, cmn[3] = 0x0000
<7> [331.595263] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mplla[0] = 0x0000
<7> [331.595346] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mplla[1] = 0x0000
<7> [331.595440] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mplla[2] = 0x0000
<7> [331.595527] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mplla[3] = 0x0000
<7> [331.595613] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mplla[4] = 0x0000
<7> [331.595697] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mplla[5] = 0x0000
<7> [331.595821] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mplla[6] = 0x0000
<7> [331.595967] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mplla[7] = 0x0000
<7> [331.596100] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mplla[8] = 0x0000
<7> [331.596233] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mplla[9] = 0x0000
<7> [331.596369] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[10] = 0x0000
<7> [331.596523] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] vdr: custom width: 0x00, serdes rate: 0x00, hdmi rate: 0x00
<7> [331.596662] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] found:
<7> [331.596799] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] cx0pll_hw_state: lane_count: 4, ssc_enabled: no, use_c10: no, tbt_mode: no
<7> [331.596945] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] c20pll_hw_state:
<7> [331.597085] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] tx[0] = 0xbe88, tx[1] = 0x4800, tx[2] = 0x0000
<7> [331.597198] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] cmn[0] = 0x0500, cmn[1] = 0x0005, cmn[2] = 0x0000, cmn[3] = 0x0000
<7> [331.597292] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[0] = 0x308c
<7> [331.597383] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[1] = 0x2110
<7> [331.597486] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[2] = 0xcc9c
<7> [331.597576] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[3] = 0xbfc1
<7> [331.597665] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[4] = 0x4b9a
<7> [331.597752] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[5] = 0x3f81
<7> [331.597837] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[6] = 0x2000
<7> [331.597926] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[7] = 0x0001
<7> [331.598012] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[8] = 0x5000
<7> [331.598098] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[9] = 0x0000
<7> [331.598185] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] mpllb[10] = 0x0000
<7> [331.598272] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] vdr: custom width: 0x00, serdes rate: 0x42, hdmi rate: 0x00
<7> [331.598356] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in pipe_bpp (expected 0, found 36)
<7> [331.598452] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.pipe_mode.crtc_clock (expected 0, found 148500)
<7> [331.598538] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in hw.adjusted_mode.crtc_clock (expected 0, found 148500)
<7> [331.598624] xe 0000:03:00.0: [drm:intel_pipe_config_compare [xe]] [CRTC:386:pipe C] fastset requirement not met in port_clock (expected 0, found 270000)
<7> [331.598710] xe 0000:03:00.0: [drm:intel_atomic_check [xe]] [CRTC:386:pipe C] fastset requirement not met, forcing full modeset
<7> [331.598815] xe 0000:03:00.0: [drm:skl_compute_wm [xe]] Enabled dbuf slices 0x1 -> 0xd (total dbuf slices 0xf), mbus joined? no->no
<7> [331.598896] xe 0000:03:00.0: [drm:skl_compute_wm [xe]] [CRTC:386:pipe C] dbuf slices 0x0 -> 0xc, ddb (0 - 0) -> (0 - 2048), active pipes 0x0 -> 0x4
<7> [331.598989] xe 0000:03:00.0: [drm:skl_compute_wm [xe]] [PLANE:270:plane 1C] ddb ( 0 - 0) -> ( 0 - 1989), size 0 -> 1989
<7> [331.599063] xe 0000:03:00.0: [drm:skl_compute_wm [xe]] [PLANE:380:cursor C] ddb ( 0 - 0) -> (1989 - 2048), size 0 -> 59
<7> [331.599136] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:270:plane 1C] level wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm -> *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm
<7> [331.599207] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:270:plane 1C] lines 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 4, 4, 9, 9, 17, 17, 17, 17, 0, 15, 0
<7> [331.599280] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:270:plane 1C] blocks 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 62, 62, 139, 139, 261, 261, 261, 261, 137, 230, 244
<7> [331.599352] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:270:plane 1C] min_ddb 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0 -> 123, 123, 245, 245, 367, 367, 0, 0, 138, 306, 306
<7> [331.599449] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] [CRTC:386:pipe C] data rate 594000 num active planes 1
<7> [331.599551] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 0: max bw 33600 required 624 qgv_peak_bw: 48000
<7> [331.599649] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] QGV point 1: max bw 53000 required 624 qgv_peak_bw: 48000
<7> [331.599739] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] Matching peaks QGV bw: 48000 for required data rate: 624
<7> [331.599848] xe 0000:03:00.0: [drm:intel_cdclk_atomic_check [xe]] [CRTC:386:pipe C] min cdclk: 0 kHz -> 192000 kHz
<7> [331.599958] xe 0000:03:00.0: [drm:intel_cdclk_update_dbuf_bw_min_cdclk [xe]] dbuf bandwidth min cdclk: 0 kHz -> 9282 kHz
<7> [331.600071] xe 0000:03:00.0: [drm:intel_find_dpll [xe]] [CRTC:386:pipe C] allocated TC PLL 2
<7> [331.600165] xe 0000:03:00.0: [drm:intel_dpll_crtc_get [xe]] [CRTC:386:pipe C] reserving TC PLL 2
<7> [331.600257] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [CRTC:386:pipe C] enable: yes [modeset]
<7> [331.600358] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] active: yes, output_types: DP (0x80), output format: RGB, sink format: RGB
<7> [331.600497] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] cpu_transcoder: C, pipe bpp: 36, dithering: 0
<7> [331.600594] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] MST master transcoder: <invalid>
<7> [331.600688] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] port sync: master transcoder: <invalid>, slave transcoder bitmask = 0x0
<7> [331.600781] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] joiner: no, pipes: 0x0
<7> [331.600873] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] splitter: disabled, link count 0, overlap 0
<7> [331.600964] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] dp m_n: lanes: 4; data_m: 5190451, data_n: 8388608, link_m: 288358, link_n: 524288, tu: 64
<7> [331.601055] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] dp m2_n2: lanes: 4; data_m: 0, data_n: 0, link_m: 0, link_n: 0, tu: 0
<7> [331.601146] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] fec: disabled, enhanced framing: enabled
<7> [331.601241] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] sdp split: disabled
<7> [331.601332] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] psr: disabled, selective update: disabled, panel replay: disabled, selective fetch: disabled
<7> [331.601431] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] minimum HBlank: 0
<7> [331.601522] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] audio: 1, infoframes: 0, infoframes enabled: 0x0
<7> [331.601612] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] ELD: 10 00 09 00 68 36 00 01 00 00 00 00 00 00 00 00
<7> [331.601702] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] ELD: 61 a4 9a 00 44 50 46 39 30 34 33 35 09 07 07 11
<7> [331.601791] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] ELD: 17 50 51 07 00 00 00 00
<7> [331.601882] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] scanline offset: 1
<7> [331.601971] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] framestart delay: 1, MSA timing delay: 0, set context latency: 0
<7> [331.602061] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] vrr: no, fixed rr: yes, vmin: 1125, vmax: 1125, flipline: 1125, pipeline full: 0, guardband: 42 vsync start: 41, vsync end: 36
<7> [331.602151] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] vrr: vmin vblank: 1083, vmax vblank: 1083, vmin vtotal: 1125, vmax vtotal: 1125
<7> [331.602240] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] vrr: dc balance: no, vmin: 0 vmax: 0 guardband: 0, slope: 0 max increase: 0 max decrease: 0 vblank target: 0
<7> [331.602330] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] requested mode: "1920x1080": 60 148500 1920 2008 2052 2200 1080 1084 1089 1125 0x48 0x5
<7> [331.602426] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] adjusted mode: "1920x1080": 60 148500 1920 2008 2052 2200 1080 1084 1089 1125 0x48 0x5
<7> [331.602517] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] crtc timings: clock=148500, hd=1920 hb=1920-2200 hs=2008-2052 ht=2200, vd=1080 vb=1080-1125 vs=1084-1089 vt=1125, flags=0x5
<7> [331.602606] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] pipe mode: "1920x1080": 60 148500 1920 2008 2052 2200 1080 1084 1089 1125 0x40 0x5
<7> [331.602696] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] crtc timings: clock=148500, hd=1920 hb=1920-2200 hs=2008-2052 ht=2200, vd=1080 vb=1080-1125 vs=1084-1089 vt=1125, flags=0x5
<7> [331.602788] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] port clock: 270000, pipe src: 1920x1080+0+0, pixel rate 148500, min cdclk 192000
<7> [331.602878] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] linetime: 119, ips linetime: 0
<7> [331.602968] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] num_scalers: 2, scaler_users: 0x0, scaler_id: -1, scaling_filter: 0
<7> [331.603057] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] pch pfit: 0x0+0+0, disabled, force thru: no
<7> [331.603146] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] ips: 0, double wide: 0, drrs: 0
<7> [331.603236] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] cx0pll_hw_state: lane_count: 4, ssc_enabled: no, use_c10: no, tbt_mode: no
<7> [331.603324] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] c20pll_hw_state:
<7> [331.603418] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] tx[0] = 0xbe88, tx[1] = 0x4800, tx[2] = 0x0000
<7> [331.603508] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] cmn[0] = 0x0500, cmn[1] = 0x0005, cmn[2] = 0x0000, cmn[3] = 0x0000
<7> [331.603598] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[0] = 0x308c
<7> [331.603687] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[1] = 0x2110
<7> [331.603776] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[2] = 0xcc9c
<7> [331.603865] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[3] = 0xbfc1
<7> [331.603953] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[4] = 0x4b9a
<7> [331.604042] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[5] = 0x3f81
<7> [331.604130] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[6] = 0x2000
<7> [331.604218] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[7] = 0x0001
<7> [331.604307] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[8] = 0x5000
<7> [331.604421] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[9] = 0x0000
<7> [331.604584] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] mpllb[10] = 0x0000
<7> [331.604720] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] vdr: custom width: 0x00, serdes rate: 0x42, hdmi rate: 0x00
<7> [331.604853] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] csc_mode: 0x0 gamma_mode: 0x0 gamma_enable: 0 csc_enable: 0
<7> [331.604987] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] pre csc lut: 0 entries, post csc lut: 0 entries
<7> [331.605126] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] output csc: pre offsets: 0x0000 0x0000 0x0000
<7> [331.605270] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] output csc: coefficients: 0x0000 0x0000 0x0000
<7> [331.605420] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] output csc: coefficients: 0x0000 0x0000 0x0000
<7> [331.605552] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] output csc: coefficients: 0x0000 0x0000 0x0000
<7> [331.605648] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] output csc: post offsets: 0x0000 0x0000 0x0000
<7> [331.605742] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] pipe csc: pre offsets: 0x0000 0x0000 0x0000
<7> [331.605832] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] pipe csc: coefficients: 0x0000 0x0000 0x0000
<7> [331.605924] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] pipe csc: coefficients: 0x0000 0x0000 0x0000
<7> [331.606015] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] pipe csc: coefficients: 0x0000 0x0000 0x0000
<7> [331.606106] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] pipe csc: post offsets: 0x0000 0x0000 0x0000
<7> [331.606196] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] sharpness strength: 0, sharpness tap size: 0, sharpness enable: 0
<7> [331.606286] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [PLANE:270:plane 1C] fb: [FB:557] 1920x1080 format = XR24 little-endian (0x34325258) modifier = 0x100000000000011, visible: yes
<7> [331.606377] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] rotation: 0x1, scaler: -1, scaling_filter: 0
<7> [331.606478] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] src: 1920.000000x1080.000000+0.000000+0.000000 dst: 1920x1080+0+0
<7> [331.606570] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [PLANE:300:plane 2C] fb: [NOFB], visible: no
<7> [331.606656] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [PLANE:330:plane 3C] fb: [NOFB], visible: no
<7> [331.606743] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [PLANE:360:plane 4C] fb: [NOFB], visible: no
<7> [331.606830] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [PLANE:370:plane 5C] fb: [NOFB], visible: no
<7> [331.606916] xe 0000:03:00.0: [drm:intel_crtc_state_dump [xe]] [PLANE:380:cursor C] fb: [NOFB], visible: no
<7> [331.607547] xe 0000:03:00.0: [drm:intel_power_well_enable [xe]] enabling always-on
<7> [331.607652] xe 0000:03:00.0: [drm:intel_power_well_enable [xe]] enabling DC_off
<7> [331.607978] xe 0000:03:00.0: [drm:gen9_set_dc_state.part.0 [xe]] Setting DC state from 02 to 00
<7> [331.608102] xe 0000:03:00.0: [drm:intel_power_well_enable [xe]] enabling PW_2
<7> [331.608434] xe 0000:03:00.0: [drm:intel_power_well_enable [xe]] enabling PW_C
<7> [331.608567] xe 0000:03:00.0: [drm:dss_pipe_gating_enable_disable [xe]] DSS clock gating enabled for pipe_mask=0x4 (CLKGATE_DIS_DSSDSC=0x8a000000)
<7> [331.608871] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:506:DDI TC1/PHY F]
<7> [331.608957] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:508:DP-MST A]
<7> [331.609041] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:509:DP-MST B]
<7> [331.609123] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:510:DP-MST C]
<7> [331.609205] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:511:DP-MST D]
<7> [331.609280] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:525:DDI TC2/PHY G]
<7> [331.609358] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:527:DP-MST A]
<7> [331.609463] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:528:DP-MST B]
<7> [331.609541] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:529:DP-MST C]
<7> [331.609619] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:530:DP-MST D]
<7> [331.609695] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:537:DDI TC3/PHY H]
<7> [331.609770] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:541:DDI TC4/PHY I]
<7> [331.609845] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:543:DP-MST A]
<7> [331.609924] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:544:DP-MST B]
<7> [331.610003] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:545:DP-MST C]
<7> [331.610079] xe 0000:03:00.0: [drm:intel_modeset_verify_disabled [xe]] [ENCODER:546:DP-MST D]
<7> [331.610369] xe 0000:03:00.0: [drm:gen9_dbuf_slices_update [xe]] Updating dbuf slices to 0xd
<7> [331.610543] xe 0000:03:00.0: [drm:intel_dbuf_mdclk_cdclk_ratio_update [xe]] Updating dbuf ratio to 2 (mbus joined: no)
<7> [331.610843] xe 0000:03:00.0: [drm:intel_dpll_enable [xe]] enable TC PLL 2 (active 0x4, on? 0) for [CRTC:386:pipe C]
<7> [331.610933] xe 0000:03:00.0: [drm:intel_dpll_enable [xe]] enabling TC PLL 2
<7> [331.613342] xe 0000:03:00.0: [drm:intel_power_well_enable [xe]] enabling AUX_TC2
<7> [331.617098] xe 0000:03:00.0: [drm:drm_dp_read_dpcd_caps [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: DPCD: 12 14 c4 01 01 15 01 81 00 01 04 01 0f 00 01
<7> [331.621849] xe 0000:03:00.0: [drm:intel_dp_init_lttpr_and_dprx_caps [xe]] [CONNECTOR:526:DP-2][ENCODER:525:DDI TC2/PHY G][DPRX] LTTPR common capabilities: 00 00 00 00 00 00 00 00
<7> [331.622863] xe 0000:03:00.0: [drm:drm_dp_read_dpcd_caps [drm_display_helper]] AUX USBC2/DDI TC2/PHY G: DPCD: 12 14 c4 01 01 15 01 81 00 01 04 01 0f 00 01
<7> [331.623298] xe 0000:03:00.0: [drm:intel_dp_start_link_train [xe]] [CONNECTOR:526:DP-2][ENCODER:525:DDI TC2/PHY G][DPRX] Using LINK_BW_SET value 0a
<7> [331.624811] xe 0000:03:00.0: [drm:intel_dp_set_signal_levels [xe]] [CONNECTOR:526:DP-2][ENCODER:525:DDI TC2/PHY G][DPRX] 8b/10b, lanes: 4, vswing levels: 0/0/0/0, pre-emphasis levels: 0/0/0/0
<7> [331.625365] xe 0000:03:00.0: [drm:intel_dp_program_link_training_pattern [xe]] [CONNECTOR:526:DP-2][ENCODER:525:DDI TC2/PHY G][DPRX] Using DP training pattern TPS1
<7> [331.631247] xe 0000:03:00.0: [drm:intel_dp_link_train_phy [xe]] [CONNECTOR:526:DP-2][ENCODER:525:DDI TC2/PHY G][DPRX] Clock recovery OK
<7> [331.631357] xe 0000:03:00.0: [drm:intel_dp_program_link_training_pattern [xe]] [CONNECTOR:526:DP-2][ENCODER:525:DDI TC2/PHY G][DPRX] Using DP training pattern TPS3
<7> [331.637242] xe 0000:03:00.0: [drm:intel_dp_link_train_phy [xe]] [CONNECTOR:526:DP-2][ENCODER:525:DDI TC2/PHY G][DPRX] Channel EQ done. DP Training successful
<7> [331.637336] xe 0000:03:00.0: [drm:intel_dp_link_train_phy [xe]] [CONNECTOR:526:DP-2][ENCODER:525:DDI TC2/PHY G][DPRX] Link Training passed at link rate = 270000, lane count = 4
<7> [331.638551] xe 0000:03:00.0: [drm:intel_enable_transcoder [xe]] enabling pipe C
<7> [331.655864] xe 0000:03:00.0: [drm:intel_audio_codec_enable [xe]] [CONNECTOR:526:DP-2][ENCODER:525:DDI TC2/PHY G] Enable audio codec on [CRTC:386:pipe C], 40 bytes ELD
<7> [331.672647] xe 0000:03:00.0: [drm:verify_connector_state [xe]] [CONNECTOR:526:DP-2]
<7> [331.673162] xe 0000:03:00.0: [drm:intel_modeset_verify_crtc [xe]] [CRTC:386:pipe C]
<7> [331.677780] xe 0000:03:00.0: [drm:skl_compute_wm [xe]] [PLANE:270:plane 1C] ddb ( 0 - 1989) -> ( 0 - 123), size 1989 -> 123
<7> [331.678068] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:270:plane 1C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> *wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm
<7> [331.678337] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:270:plane 1C] lines 4, 4, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 4, 4, 4, 4, 4, 4, 4, 4, 0, 0, 0
<7> [331.678635] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:270:plane 1C] blocks 62, 62, 139, 139, 261, 261, 261, 261, 137, 230, 244 -> 62, 62, 62, 62, 62, 62, 62, 62, 0, 0, 0
<7> [331.678872] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:270:plane 1C] min_ddb 123, 123, 245, 245, 367, 367, 0, 0, 138, 306, 306 -> 123, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [331.679340] xe 0000:03:00.0: [drm:skl_compute_wm [xe]] [PLANE:270:plane 1C] ddb ( 0 - 1989) -> ( 0 - 123), size 1989 -> 123
<7> [331.679599] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:270:plane 1C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> *wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm
<7> [331.679805] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:270:plane 1C] lines 4, 4, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 4, 4, 4, 4, 4, 4, 4, 4, 0, 0, 0
<7> [331.680009] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:270:plane 1C] blocks 62, 62, 139, 139, 261, 261, 261, 261, 137, 230, 244 -> 62, 62, 62, 62, 62, 62, 62, 62, 0, 0, 0
<7> [331.680213] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:270:plane 1C] min_ddb 123, 123, 245, 245, 367, 367, 0, 0, 138, 306, 306 -> 123, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [331.680603] xe 0000:03:00.0: [drm:skl_compute_wm [xe]] [PLANE:270:plane 1C] ddb ( 0 - 1989) -> ( 0 - 123), size 1989 -> 123
<7> [331.680793] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:270:plane 1C] level *wm0,*wm1,*wm2,*wm3,*wm4,*wm5, wm6, wm7,*twm,*swm,*stwm -> *wm0, wm1, wm2, wm3, wm4, wm5, wm6, wm7, twm, swm, stwm
<7> [331.680979] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:270:plane 1C] lines 4, 4, 9, 9, 17, 17, 17, 17, 0, 15, 0 -> 4, 4, 4, 4, 4, 4, 4, 4, 0, 0, 0
<7> [331.681166] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:270:plane 1C] blocks 62, 62, 139, 139, 261, 261, 261, 261, 137, 230, 244 -> 62, 62, 62, 62, 62, 62, 62, 62, 0, 0, 0
<7> [331.681345] xe 0000:03:00.0: [drm:skl_print_plane_changes [xe]] [PLANE:270:plane 1C] min_ddb 123, 123, 245, 245, 367, 367, 0, 0, 138, 306, 306 -> 123, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0
<7> [331.681572] xe 0000:03:00.0: [drm:intel_bw_atomic_check [xe]] No SAGV, use UINT_MAX as peak bw.
<7> [331.742417] xe 0000:03:00.0: [drm:intel_power_well_disable [xe]] disabling AUX_TC2
<7> [333.654491] xe 0000:03:00.0: [drm:intel_power_well_enable [xe]] enabling AUX_TC2
<6> [333.678134] [IGT] kms_async_flips: finished subtest pipe-C-DP-2-4-rc-ccs, SUCCESS
Created at 2026-02-26 16:56:14