Results for igt@xe_pat@pt-caching

Result: Abort 416 Warning(s)

i915_display_info5 igt_runner5 results5.json results5-xe-load.json guc_logs5.tar i915_display_info_post_exec5 boot5 dmesg5

DetailValue
Duration unknown
Hostname
shard-bmg-9
Igt-Version
IGT-Version: 2.4-gd66319e7a (x86_64) (Linux: 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ x86_64)
Out
Using IGT_SRANDOM=1775217516 for randomisation
Opened device: /dev/dri/card0
Test requirement not met in function __igt_unique____real_main2210, file ../tests/intel/xe_pat.c:2298:
Test requirement: intel_graphics_ver(dev_id) == IP_VER(35, 10)
Last errno: 2, No such file or directory
Starting subtest: pt-caching
va_bits: 48, num_objs: 16384, spread over pt levels:
[0]: 16384
[1]: 512
[2]: 16
Subtest pt-caching: SUCCESS (11.157s)

This test caused an abort condition: Kernel badly tainted (0x244, 0x200) (check dmesg for details):
	TAINT_WARN: WARN_ON has happened.
Err
Starting subtest: pt-caching
Subtest pt-caching: SUCCESS (11.157s)
Dmesg

<6> [257.393682] Console: switching to colour dummy device 80x25
<6> [257.394017] [IGT] xe_pat: executing
<6> [257.412347] [IGT] xe_pat: starting subtest pt-caching
<6> [258.979756] xe 0000:03:00.0: [drm] Tile0: GT0:
ASID: 0
Faulted Address: 0x0000410418800000
FaultType: 0
AccessType: 0
FaultLevel: 3
EngineClass: 3 bcs
EngineInstance: 8
<6> [258.979770] xe 0000:03:00.0: [drm] Tile0: GT0: Fault response: Unsuccessful -EINVAL
<6> [258.979817] xe 0000:03:00.0: [drm] Tile0: GT0: Engine memory CAT error [18]: class=bcs, logical_mask: 0x2, guc_id=0
<7> [258.980510] xe 0000:03:00.0: [drm:xe_hw_engine_snapshot_capture [xe]] Tile0: GT0: Proceeding with manual engine snapshot
<6> [258.981012] xe 0000:03:00.0: [drm] Tile0: GT0: Engine reset: engine_class=bcs, logical_mask: 0x2, guc_id=0, state=0x249
<5> [258.981023] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72102, lrc_seqno=72102, guc_id=0, flags=0x73 in no process [-1]
<6> [259.160414] xe 0000:03:00.0: [drm] Xe device coredump has been created
<6> [259.160436] xe 0000:03:00.0: [drm] Check your /sys/class/drm/card0/device/devcoredump/data
<4> [259.160439] ------------[ cut here ]------------
<4> [259.160441] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.160442] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:50/5136
<4> [259.160535] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.160685] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.160690] CPU: 11 UID: 0 PID: 5136 Comm: kworker/u64:50 Tainted: G S U 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.160693] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER
<4> [259.160694] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.160696] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.160702] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.160768] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.160769] RSP: 0018:ffffc90002347ca0 EFLAGS: 00010246
<4> [259.160772] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.160774] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.160775] RBP: ffffc90002347db0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.160777] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.160778] R13: ffff888103fd1610 R14: ffff88811d3a8000 R15: 00000000fffffffb
<4> [259.160779] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [259.160781] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.160782] CR2: 000070a320be61b4 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [259.160784] PKRU: 55555554
<4> [259.160785] Call Trace:
<4> [259.160787] <TASK>
<4> [259.160791] ? lock_acquire+0x20/0x2f0
<4> [259.160797] ? __pfx_autoremove_wake_function+0x10/0x10
<4> [259.160803] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.160808] process_one_work+0x239/0x760
<4> [259.160815] worker_thread+0x200/0x3f0
<4> [259.160818] ? __pfx_worker_thread+0x10/0x10
<4> [259.160821] kthread+0x10d/0x150
<4> [259.160824] ? __pfx_kthread+0x10/0x10
<4> [259.160828] ret_from_fork+0x3d4/0x480
<4> [259.160831] ? __pfx_kthread+0x10/0x10
<4> [259.160834] ret_from_fork_asm+0x1a/0x30
<4> [259.160841] </TASK>
<4> [259.160843] irq event stamp: 1307447
<4> [259.160844] hardirqs last enabled at (1307453): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.160847] hardirqs last disabled at (1307458): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.160850] softirqs last enabled at (1306598): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.160852] softirqs last disabled at (1306593): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.160855] ---[ end trace 0000000000000000 ]---
<6> [259.160857] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.160921] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.161300] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.161946] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.162722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.162819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.162900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.162978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.163053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.163124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.163199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.163275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.163346] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.163428] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.163531] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.164745] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.174669] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.174943] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.176489] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.176570] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.176659] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.176738] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.176815] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.176885] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.176954] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.177021] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.177088] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.177154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.177219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.177284] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.177348] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.177413] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.177477] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.177542] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.177617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.177704] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.177775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.177856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.177936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.178013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.178090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.178166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.178238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.178311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.178388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.178463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.178540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.178646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.178721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.178790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.178864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.178938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.179011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.179080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.179150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.179216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.179281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.179344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.179411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.179476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.179543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.179617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.179694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.179766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.179831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.179895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.179961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.180027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.180094] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.180162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.180229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.180297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.180364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.180433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.180501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.180568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.180650] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.181170] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.181176] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72102, lrc_seqno=72102, guc_id=0, flags=0x73 in no process [-1]
<7> [259.181180] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.181246] ------------[ cut here ]------------
<4> [259.181247] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.181248] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:50/5136
<4> [259.181326] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.181395] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.181401] CPU: 11 UID: 0 PID: 5136 Comm: kworker/u64:50 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.181404] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.181406] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.181407] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.181413] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.181488] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.181490] RSP: 0018:ffffc90002347ca0 EFLAGS: 00010246
<4> [259.181492] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.181494] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.181495] RBP: ffffc90002347db0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.181496] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.181497] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.181499] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [259.181501] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.181502] CR2: 000070a320be61b4 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [259.181504] PKRU: 55555554
<4> [259.181505] Call Trace:
<4> [259.181506] <TASK>
<4> [259.181510] ? lock_acquire+0x20/0x2f0
<4> [259.181517] ? lock_release+0xd0/0x2b0
<4> [259.181522] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.181528] process_one_work+0x239/0x760
<4> [259.181535] worker_thread+0x200/0x3f0
<4> [259.181538] ? __pfx_worker_thread+0x10/0x10
<4> [259.181541] kthread+0x10d/0x150
<4> [259.181544] ? __pfx_kthread+0x10/0x10
<4> [259.181548] ret_from_fork+0x3d4/0x480
<4> [259.181551] ? __pfx_kthread+0x10/0x10
<4> [259.181554] ret_from_fork_asm+0x1a/0x30
<4> [259.181562] </TASK>
<4> [259.181563] irq event stamp: 1310557
<4> [259.181564] hardirqs last enabled at (1310563): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.181568] hardirqs last disabled at (1310568): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.181570] softirqs last enabled at (1309494): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.181573] softirqs last disabled at (1309487): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.181575] ---[ end trace 0000000000000000 ]---
<6> [259.181577] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.181665] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.181672] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.182079] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.182286] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.182380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.182471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.182557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.182649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.182733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.182814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.182898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.182978] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.183076] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.183193] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.184206] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.194591] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.194869] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.195918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.196000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.196076] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.196152] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.196226] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.196299] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.196370] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.196442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.196513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.196589] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.196660] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.196730] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.196801] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.196872] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.196945] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.197016] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.197088] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.197159] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.197231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.197314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.197395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.197475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.197553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.197642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.197719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.197793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.197867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.197944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.198021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.198096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.198170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.198244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.198323] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.198405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.198486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.198563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.198662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.198735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.198810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.198883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.198960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.199036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.199114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.199190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.199274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.199351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.199437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.199512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.199592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.199662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.199735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.199806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.199875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.199944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.200012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.200081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.200148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.200216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.200288] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.200519] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.200524] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72102, lrc_seqno=72102, guc_id=0, flags=0x73 in no process [-1]
<7> [259.200527] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.201734] ------------[ cut here ]------------
<4> [259.201735] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.201737] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:50/5136
<4> [259.201813] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.201883] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.201887] CPU: 11 UID: 0 PID: 5136 Comm: kworker/u64:50 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.201891] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.201892] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.201893] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.201899] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.201966] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.201968] RSP: 0018:ffffc90002347ca0 EFLAGS: 00010246
<4> [259.201970] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.201972] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.201973] RBP: ffffc90002347db0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.201974] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.201976] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.201977] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [259.201979] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.201980] CR2: 000070a320be61b4 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [259.201981] PKRU: 55555554
<4> [259.201983] Call Trace:
<4> [259.201984] <TASK>
<4> [259.201988] ? lock_acquire+0x20/0x2f0
<4> [259.201994] ? lock_release+0xd0/0x2b0
<4> [259.202000] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.202005] process_one_work+0x239/0x760
<4> [259.202012] worker_thread+0x200/0x3f0
<4> [259.202015] ? __pfx_worker_thread+0x10/0x10
<4> [259.202017] kthread+0x10d/0x150
<4> [259.202021] ? __pfx_kthread+0x10/0x10
<4> [259.202024] ret_from_fork+0x3d4/0x480
<4> [259.202027] ? __pfx_kthread+0x10/0x10
<4> [259.202030] ret_from_fork_asm+0x1a/0x30
<4> [259.202038] </TASK>
<4> [259.202039] irq event stamp: 1313671
<4> [259.202040] hardirqs last enabled at (1313677): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.202043] hardirqs last disabled at (1313682): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.202045] softirqs last enabled at (1312664): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.202048] softirqs last disabled at (1312657): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.202050] ---[ end trace 0000000000000000 ]---
<7> [259.202600] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [259.202703] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [259.202798] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72157, lrc_seqno=72157, guc_id=0, flags=0x73 in no process [-1]
<7> [259.202801] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.202859] ------------[ cut here ]------------
<4> [259.202860] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.202861] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:50/5136
<4> [259.202931] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.202998] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.203003] CPU: 11 UID: 0 PID: 5136 Comm: kworker/u64:50 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.203005] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.203007] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.203008] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.203013] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.203080] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.203082] RSP: 0018:ffffc90002347ca0 EFLAGS: 00010246
<4> [259.203084] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.203085] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.203087] RBP: ffffc90002347db0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.203088] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.203089] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.203090] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [259.203092] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.203093] CR2: 000070a320be61b4 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [259.203094] PKRU: 55555554
<4> [259.203096] Call Trace:
<4> [259.203097] <TASK>
<4> [259.203100] ? lock_acquire+0x20/0x2f0
<4> [259.203106] ? lock_release+0xd0/0x2b0
<4> [259.203111] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.203117] process_one_work+0x239/0x760
<4> [259.203123] worker_thread+0x200/0x3f0
<4> [259.203126] ? __pfx_worker_thread+0x10/0x10
<4> [259.203128] kthread+0x10d/0x150
<4> [259.203131] ? __pfx_kthread+0x10/0x10
<4> [259.203135] ret_from_fork+0x3d4/0x480
<4> [259.203137] ? __pfx_kthread+0x10/0x10
<4> [259.203141] ret_from_fork_asm+0x1a/0x30
<4> [259.203148] </TASK>
<4> [259.203149] irq event stamp: 1315829
<4> [259.203151] hardirqs last enabled at (1315835): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.203154] hardirqs last disabled at (1315840): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.203156] softirqs last enabled at (1315032): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.203158] softirqs last disabled at (1315021): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.203160] ---[ end trace 0000000000000000 ]---
<6> [259.203162] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.203228] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.203235] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.203361] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.203561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.203656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.203743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.203825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.203903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.203980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.204061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.204139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.204215] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.204303] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.204414] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.205417] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.215588] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.215837] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.216860] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.216936] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.217007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.217077] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.217147] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.217219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.217291] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.217361] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.217430] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.217500] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.217568] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.217651] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.217721] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.217788] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.217856] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.217924] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.217991] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.218059] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.218126] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.218202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.218277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.218350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.218423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.218495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.218566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.218649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.218717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.218788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.218859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.218929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.219001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.219074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.219151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.219228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.219307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.219380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.219451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.219521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.219595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.219663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.219733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.219805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.219873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.219941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.220013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.220081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.220149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.220215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.220285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.220352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.220420] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.220492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.220561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.220642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.220712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.220785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.220852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.220919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.220991] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.221099] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.221103] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72157, lrc_seqno=72157, guc_id=0, flags=0x73 in no process [-1]
<7> [259.221105] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.221162] ------------[ cut here ]------------
<4> [259.221163] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.221165] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:50/5136
<4> [259.221232] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.221298] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.221302] CPU: 11 UID: 0 PID: 5136 Comm: kworker/u64:50 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.221305] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.221306] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.221307] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.221312] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.221379] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.221381] RSP: 0018:ffffc90002347ca0 EFLAGS: 00010246
<4> [259.221383] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.221384] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.221386] RBP: ffffc90002347db0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.221387] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.221388] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.221390] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [259.221391] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.221392] CR2: 000070a320be61b4 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [259.221394] PKRU: 55555554
<4> [259.221395] Call Trace:
<4> [259.221396] <TASK>
<4> [259.221400] ? lock_acquire+0x20/0x2f0
<4> [259.221405] ? lock_release+0xd0/0x2b0
<4> [259.221410] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.221416] process_one_work+0x239/0x760
<4> [259.221422] worker_thread+0x200/0x3f0
<4> [259.221425] ? __pfx_worker_thread+0x10/0x10
<4> [259.221427] kthread+0x10d/0x150
<4> [259.221430] ? __pfx_kthread+0x10/0x10
<4> [259.221434] ret_from_fork+0x3d4/0x480
<4> [259.221436] ? __pfx_kthread+0x10/0x10
<4> [259.221439] ret_from_fork_asm+0x1a/0x30
<4> [259.221447] </TASK>
<4> [259.221448] irq event stamp: 1318909
<4> [259.221449] hardirqs last enabled at (1318915): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.221452] hardirqs last disabled at (1318920): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.221454] softirqs last enabled at (1317716): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.221457] softirqs last disabled at (1317711): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.221459] ---[ end trace 0000000000000000 ]---
<6> [259.221461] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.221527] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.221533] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.222548] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [259.222659] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [259.222887] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.223099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.223191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.223281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.223365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.223446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.223525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.223611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.223692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.223768] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.223858] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.223970] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.224975] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.235585] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.235834] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.236853] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.236930] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.237003] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.237073] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.237144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.237212] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.237281] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.237351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.237419] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.237488] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.237556] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.237664] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.237734] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.237802] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.237870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.237939] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.238008] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.238075] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.238143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.238219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.238294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.238367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.238439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.238508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.238583] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.238653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.238721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.238793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.238868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.238939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.239010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.239079] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.239155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.239230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.239304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.239378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.239450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.239519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.239592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.239663] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.239733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.239803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.239872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.239941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.240012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.240080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.240148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.240216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.240285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.240351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.240418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.240488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.240556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.240633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.240701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.240772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.240837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.240907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.240977] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.241086] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.241094] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72157, lrc_seqno=72157, guc_id=0, flags=0x73 in no process [-1]
<7> [259.241099] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.241292] ------------[ cut here ]------------
<4> [259.241295] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.241297] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:220/7011
<4> [259.241393] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.241467] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.241472] CPU: 4 UID: 0 PID: 7011 Comm: kworker/u64:220 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.241476] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.241477] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.241479] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.241486] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.241564] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.241566] RSP: 0000:ffffc90007527ca0 EFLAGS: 00010246
<4> [259.241568] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.241569] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.241571] RBP: ffffc90007527db0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.241572] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.241573] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.241575] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000
<4> [259.241576] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.241588] CR2: 000072daabc20008 CR3: 0000000124092004 CR4: 0000000000f72ef0
<4> [259.241591] PKRU: 55555554
<4> [259.241592] Call Trace:
<4> [259.241594] <TASK>
<4> [259.241600] ? lock_acquire+0x20/0x2f0
<4> [259.241606] ? lock_release+0xd0/0x2b0
<4> [259.241611] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.241618] process_one_work+0x239/0x760
<4> [259.241625] worker_thread+0x200/0x3f0
<4> [259.241628] ? __pfx_worker_thread+0x10/0x10
<4> [259.241630] kthread+0x10d/0x150
<4> [259.241635] ? __pfx_kthread+0x10/0x10
<4> [259.241639] ret_from_fork+0x3d4/0x480
<4> [259.241641] ? __pfx_kthread+0x10/0x10
<4> [259.241645] ret_from_fork_asm+0x1a/0x30
<4> [259.241652] </TASK>
<4> [259.241654] irq event stamp: 401127
<4> [259.241656] hardirqs last enabled at (401133): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.241662] hardirqs last disabled at (401138): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.241664] softirqs last enabled at (401026): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.241668] softirqs last disabled at (401019): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.241670] ---[ end trace 0000000000000000 ]---
<7> [259.242021] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [259.242120] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [259.242797] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72212, lrc_seqno=72212, guc_id=0, flags=0x73 in no process [-1]
<7> [259.242800] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.242861] ------------[ cut here ]------------
<4> [259.242862] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.242864] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:50/5136
<4> [259.242936] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.243001] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.243005] CPU: 11 UID: 0 PID: 5136 Comm: kworker/u64:50 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.243008] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.243009] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.243011] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.243016] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.243084] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.243086] RSP: 0018:ffffc90002347ca0 EFLAGS: 00010246
<4> [259.243088] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.243089] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.243091] RBP: ffffc90002347db0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.243092] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.243093] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.243094] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [259.243096] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.243097] CR2: 000070a320be61b4 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [259.243099] PKRU: 55555554
<4> [259.243100] Call Trace:
<4> [259.243101] <TASK>
<4> [259.243105] ? lock_acquire+0x20/0x2f0
<4> [259.243110] ? lock_release+0xd0/0x2b0
<4> [259.243116] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.243121] process_one_work+0x239/0x760
<4> [259.243127] worker_thread+0x200/0x3f0
<4> [259.243130] ? __pfx_worker_thread+0x10/0x10
<4> [259.243132] kthread+0x10d/0x150
<4> [259.243135] ? __pfx_kthread+0x10/0x10
<4> [259.243139] ret_from_fork+0x3d4/0x480
<4> [259.243141] ? __pfx_kthread+0x10/0x10
<4> [259.243144] ret_from_fork_asm+0x1a/0x30
<4> [259.243152] </TASK>
<4> [259.243153] irq event stamp: 1322587
<4> [259.243154] hardirqs last enabled at (1322593): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.243157] hardirqs last disabled at (1322598): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.243159] softirqs last enabled at (1321640): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.243162] softirqs last disabled at (1321477): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.243164] ---[ end trace 0000000000000000 ]---
<6> [259.243165] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.243231] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.243237] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.243464] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.243670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.243757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.243845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.243926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.244008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.244087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.244165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.244245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.244321] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.244413] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.244524] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.245528] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.255592] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.255841] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.257070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.257148] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.257220] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.257291] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.257363] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.257432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.257501] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.257570] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.257655] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.257724] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.257792] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.257859] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.257926] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.257994] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.258064] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.258133] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.258202] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.258270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.258338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.258414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.258489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.258560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.258647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.258719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.258788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.258857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.258924] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.258994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.259064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.259133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.259202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.259271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.259349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.259425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.259501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.259579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.259653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.259721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.259790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.259860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.259931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.260002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.260071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.260139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.260210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.260278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.260348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.260417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.260488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.260555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.260634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.260707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.260774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.260843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.260913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.260983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.261051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.261119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.261190] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.261298] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.261302] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72212, lrc_seqno=72212, guc_id=0, flags=0x73 in no process [-1]
<7> [259.261304] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.261361] ------------[ cut here ]------------
<4> [259.261362] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.261364] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:50/5136
<4> [259.261434] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.261497] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.261502] CPU: 11 UID: 0 PID: 5136 Comm: kworker/u64:50 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.261505] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.261506] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.261507] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.261512] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.261581] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.261583] RSP: 0018:ffffc90002347ca0 EFLAGS: 00010246
<4> [259.261586] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.261587] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.261589] RBP: ffffc90002347db0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.261590] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.261591] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.261593] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [259.261595] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.261596] CR2: 000070a320be61b4 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [259.261598] PKRU: 55555554
<4> [259.261599] Call Trace:
<4> [259.261601] <TASK>
<4> [259.261604] ? lock_acquire+0x20/0x2f0
<4> [259.261610] ? lock_release+0xd0/0x2b0
<4> [259.261615] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.261620] process_one_work+0x239/0x760
<4> [259.261627] worker_thread+0x200/0x3f0
<4> [259.261629] ? __pfx_worker_thread+0x10/0x10
<4> [259.261632] kthread+0x10d/0x150
<4> [259.261635] ? __pfx_kthread+0x10/0x10
<4> [259.261639] ret_from_fork+0x3d4/0x480
<4> [259.261641] ? __pfx_kthread+0x10/0x10
<4> [259.261644] ret_from_fork_asm+0x1a/0x30
<4> [259.261652] </TASK>
<4> [259.261653] irq event stamp: 1325685
<4> [259.261654] hardirqs last enabled at (1325691): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.261657] hardirqs last disabled at (1325696): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.261659] softirqs last enabled at (1324782): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.261662] softirqs last disabled at (1324775): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.261664] ---[ end trace 0000000000000000 ]---
<6> [259.261666] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.261732] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.261738] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.262980] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [259.263083] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [259.263181] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.263391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.263481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.263569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.263687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.263766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.263844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.263923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.264003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.264080] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.264171] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.264282] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.265287] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.275582] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.275827] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.276845] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.276918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.276988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.277059] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.277129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.277200] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.277270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.277340] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.277409] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.277477] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.277545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.277623] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.277691] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.277758] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.277826] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.277894] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.277960] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.278027] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.278097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.278172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.278247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.278319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.278393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.278465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.278534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.278616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.278688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.278761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.278833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.278902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.278973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.279046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.279124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.279199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.279273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.279344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.279414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.279484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.279554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.279635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.279708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.279779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.279849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.279916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.279988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.280057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.280125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.280192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.280260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.280330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.280399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.280471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.280543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.280621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.280687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.280755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.280824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.280893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.280965] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.281075] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.281079] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72212, lrc_seqno=72212, guc_id=0, flags=0x73 in no process [-1]
<7> [259.281081] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.281139] ------------[ cut here ]------------
<4> [259.281141] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.281142] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:220/7011
<4> [259.281212] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.281278] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.281283] CPU: 4 UID: 0 PID: 7011 Comm: kworker/u64:220 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.281285] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.281287] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.281288] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.281293] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.281360] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.281362] RSP: 0000:ffffc90007527ca0 EFLAGS: 00010246
<4> [259.281364] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.281366] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.281367] RBP: ffffc90007527db0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.281368] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.281370] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.281371] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000
<4> [259.281372] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.281374] CR2: 000072daabc20008 CR3: 0000000124092004 CR4: 0000000000f72ef0
<4> [259.281375] PKRU: 55555554
<4> [259.281377] Call Trace:
<4> [259.281378] <TASK>
<4> [259.281382] ? lock_acquire+0x20/0x2f0
<4> [259.281388] ? lock_release+0xd0/0x2b0
<4> [259.281393] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.281399] process_one_work+0x239/0x760
<4> [259.281405] worker_thread+0x200/0x3f0
<4> [259.281407] ? __pfx_worker_thread+0x10/0x10
<4> [259.281410] kthread+0x10d/0x150
<4> [259.281413] ? __pfx_kthread+0x10/0x10
<4> [259.281417] ret_from_fork+0x3d4/0x480
<4> [259.281419] ? __pfx_kthread+0x10/0x10
<4> [259.281422] ret_from_fork_asm+0x1a/0x30
<4> [259.281429] </TASK>
<4> [259.281430] irq event stamp: 407093
<4> [259.281432] hardirqs last enabled at (407099): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.281434] hardirqs last disabled at (407104): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.281436] softirqs last enabled at (406214): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.281439] softirqs last disabled at (406207): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.281441] ---[ end trace 0000000000000000 ]---
<5> [259.283104] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72267, lrc_seqno=72267, guc_id=0, flags=0x73 in no process [-1]
<7> [259.283109] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.283202] ------------[ cut here ]------------
<4> [259.283204] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.283206] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:220/7011
<4> [259.283315] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.283441] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.283449] CPU: 4 UID: 0 PID: 7011 Comm: kworker/u64:220 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.283453] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.283455] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.283458] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.283466] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.283569] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.283572] RSP: 0000:ffffc90007527ca0 EFLAGS: 00010246
<4> [259.283581] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.283583] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.283586] RBP: ffffc90007527db0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.283589] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.283591] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.283593] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000
<4> [259.283596] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.283598] CR2: 000072daabc20008 CR3: 0000000124092004 CR4: 0000000000f72ef0
<4> [259.283601] PKRU: 55555554
<4> [259.283603] Call Trace:
<4> [259.283605] <TASK>
<4> [259.283612] ? lock_acquire+0x20/0x2f0
<4> [259.283622] ? lock_release+0xd0/0x2b0
<4> [259.283630] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.283640] process_one_work+0x239/0x760
<4> [259.283652] worker_thread+0x200/0x3f0
<4> [259.283657] ? __pfx_worker_thread+0x10/0x10
<4> [259.283661] kthread+0x10d/0x150
<4> [259.283665] ? __pfx_kthread+0x10/0x10
<4> [259.283672] ret_from_fork+0x3d4/0x480
<4> [259.283675] ? __pfx_kthread+0x10/0x10
<4> [259.283681] ret_from_fork_asm+0x1a/0x30
<4> [259.283695] </TASK>
<4> [259.283697] irq event stamp: 409219
<4> [259.283699] hardirqs last enabled at (409225): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.283703] hardirqs last disabled at (409230): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.283707] softirqs last enabled at (406214): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.283711] softirqs last disabled at (406207): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.283715] ---[ end trace 0000000000000000 ]---
<7> [259.283735] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [259.283880] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<6> [259.284017] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.284124] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.284134] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.284311] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.284560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.284713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.284843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.284965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.285089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.285211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.285338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.285465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.285593] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.285723] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.285873] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.286971] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.297586] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.297844] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.298872] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.298950] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.299023] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.299095] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.299166] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.299237] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.299306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.299375] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.299443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.299514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.299596] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.299666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.299736] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.299804] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.299871] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.299940] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.300007] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.300073] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.300139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.300216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.300290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.300362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.300435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.300505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.300580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.300651] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.300721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.300794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.300866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.300936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.301007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.301078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.301156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.301233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.301309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.301381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.301452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.301521] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.301595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.301664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.301735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.301804] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.301874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.301941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.302014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.302083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.302152] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.302220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.302289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.302358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.302424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.302493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.302561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.302644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.302714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.302782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.302849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.302916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.302986] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.303095] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.303099] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72267, lrc_seqno=72267, guc_id=0, flags=0x73 in no process [-1]
<7> [259.303102] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.303157] ------------[ cut here ]------------
<4> [259.303159] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.303160] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:220/7011
<4> [259.303229] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.303293] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.303298] CPU: 4 UID: 0 PID: 7011 Comm: kworker/u64:220 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.303301] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.303302] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.303304] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.303309] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.303375] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.303377] RSP: 0000:ffffc90007527ca0 EFLAGS: 00010246
<4> [259.303379] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.303381] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.303383] RBP: ffffc90007527db0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.303384] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.303386] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.303387] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000
<4> [259.303389] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.303390] CR2: 000072daabc20008 CR3: 0000000124092004 CR4: 0000000000f72ef0
<4> [259.303392] PKRU: 55555554
<4> [259.303393] Call Trace:
<4> [259.303395] <TASK>
<4> [259.303399] ? lock_acquire+0x20/0x2f0
<4> [259.303405] ? lock_release+0xd0/0x2b0
<4> [259.303410] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.303416] process_one_work+0x239/0x760
<4> [259.303422] worker_thread+0x200/0x3f0
<4> [259.303425] ? __pfx_worker_thread+0x10/0x10
<4> [259.303428] kthread+0x10d/0x150
<4> [259.303431] ? __pfx_kthread+0x10/0x10
<4> [259.303435] ret_from_fork+0x3d4/0x480
<4> [259.303437] ? __pfx_kthread+0x10/0x10
<4> [259.303440] ret_from_fork_asm+0x1a/0x30
<4> [259.303448] </TASK>
<4> [259.303449] irq event stamp: 412325
<4> [259.303451] hardirqs last enabled at (412331): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.303454] hardirqs last disabled at (412336): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.303456] softirqs last enabled at (411342): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.303458] softirqs last disabled at (411335): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.303461] ---[ end trace 0000000000000000 ]---
<6> [259.303463] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.303528] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.303534] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.304762] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [259.304864] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [259.304963] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.305167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.305247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.305332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.305409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.305486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.305562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.305675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.305759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.305836] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.305924] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.306034] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.307040] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.317577] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.317829] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.318859] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.318934] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.319004] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.319077] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.319149] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.319219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.319287] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.319354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.319420] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.319490] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.319556] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.319637] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.319707] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.319773] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.319841] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.319907] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.319973] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.320041] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.320109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.320186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.320262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.320337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.320411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.320482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.320552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.320633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.320705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.320777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.320851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.320922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.320994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.321066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.321143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.321220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.321296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.321368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.321440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.321510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.321585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.321657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.321731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.321801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.321870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.321940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.322011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.322080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.322150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.322217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.322289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.322359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.322429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.322501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.322573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.322644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.322712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.322782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.322849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.322917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.322990] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.323101] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.323105] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72267, lrc_seqno=72267, guc_id=0, flags=0x73 in no process [-1]
<7> [259.323107] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.323163] ------------[ cut here ]------------
<4> [259.323165] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.323166] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:221/7012
<4> [259.323234] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.323299] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.323304] CPU: 2 UID: 0 PID: 7012 Comm: kworker/u64:221 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.323307] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.323308] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.323309] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.323315] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.323382] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.323384] RSP: 0018:ffffc9000752fca0 EFLAGS: 00010246
<4> [259.323386] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.323387] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.323389] RBP: ffffc9000752fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.323390] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.323391] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.323393] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [259.323394] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.323396] CR2: 00007d71ab715098 CR3: 000000000344c002 CR4: 0000000000f72ef0
<4> [259.323397] PKRU: 55555554
<4> [259.323398] Call Trace:
<4> [259.323399] <TASK>
<4> [259.323403] ? lock_acquire+0x20/0x2f0
<4> [259.323409] ? lock_release+0xd0/0x2b0
<4> [259.323415] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.323420] process_one_work+0x239/0x760
<4> [259.323426] worker_thread+0x200/0x3f0
<4> [259.323429] ? __pfx_worker_thread+0x10/0x10
<4> [259.323432] kthread+0x10d/0x150
<4> [259.323435] ? __pfx_kthread+0x10/0x10
<4> [259.323438] ret_from_fork+0x3d4/0x480
<4> [259.323440] ? __pfx_kthread+0x10/0x10
<4> [259.323444] ret_from_fork_asm+0x1a/0x30
<4> [259.323451] </TASK>
<4> [259.323452] irq event stamp: 186793
<4> [259.323453] hardirqs last enabled at (186799): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.323456] hardirqs last disabled at (186804): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.323458] softirqs last enabled at (185810): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.323461] softirqs last disabled at (185803): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.323463] ---[ end trace 0000000000000000 ]---
<5> [259.324093] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72322, lrc_seqno=72322, guc_id=0, flags=0x73 in no process [-1]
<7> [259.324098] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.324442] ------------[ cut here ]------------
<4> [259.324444] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.324447] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:220/7011
<4> [259.324619] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.324743] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.324753] CPU: 4 UID: 0 PID: 7011 Comm: kworker/u64:220 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.324757] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.324760] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.324763] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.324773] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.324944] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.324949] RSP: 0000:ffffc90007527ca0 EFLAGS: 00010246
<4> [259.324954] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.324957] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.324958] RBP: ffffc90007527db0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.324960] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.324963] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.324966] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000
<4> [259.324968] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.324971] CR2: 000072daabc20008 CR3: 0000000124092004 CR4: 0000000000f72ef0
<4> [259.324973] PKRU: 55555554
<4> [259.324976] Call Trace:
<4> [259.324979] <TASK>
<4> [259.324985] ? lock_acquire+0x20/0x2f0
<4> [259.324995] ? lock_release+0xd0/0x2b0
<4> [259.325004] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.325015] process_one_work+0x239/0x760
<4> [259.325026] worker_thread+0x200/0x3f0
<4> [259.325030] ? __pfx_worker_thread+0x10/0x10
<4> [259.325034] kthread+0x10d/0x150
<4> [259.325038] ? __pfx_kthread+0x10/0x10
<4> [259.325043] ret_from_fork+0x3d4/0x480
<4> [259.325046] ? __pfx_kthread+0x10/0x10
<4> [259.325052] ret_from_fork_asm+0x1a/0x30
<4> [259.325064] </TASK>
<4> [259.325067] irq event stamp: 414501
<4> [259.325069] hardirqs last enabled at (414507): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.325073] hardirqs last disabled at (414512): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.325077] softirqs last enabled at (412442): [<ffffffff81339c23>] kernel_fpu_end+0x53/0x70
<4> [259.325081] softirqs last disabled at (412440): [<ffffffff8133a334>] kernel_fpu_begin_mask+0xc4/0x120
<4> [259.325085] ---[ end trace 0000000000000000 ]---
<6> [259.325088] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.325193] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<7> [259.325154] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [259.325257] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<6> [259.325445] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.325497] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.325994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.326082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.326170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.326252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.326331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.326410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.326488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.326568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.326658] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.326746] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.326854] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.327858] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.337575] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.337822] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.339337] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.339458] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.339576] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.339689] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.339800] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.339910] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.340017] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.340124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.340230] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.340340] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.340449] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.340556] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.340703] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.340813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.340918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.341027] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.341134] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.341242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.341379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.341495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.341642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.341719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.341794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.341865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.341936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.342006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.342075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.342149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.342222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.342294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.342366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.342438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.342515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.342605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.342682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.342758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.342831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.342901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.342969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.343038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.343108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.343178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.343247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.343315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.343388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.343457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.343527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.343605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.343675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.343743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.343813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.343883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.343953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.344021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.344088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.344157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.344225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.344292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.344362] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.344470] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.344474] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72322, lrc_seqno=72322, guc_id=0, flags=0x73 in no process [-1]
<7> [259.344476] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.344532] ------------[ cut here ]------------
<4> [259.344533] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.344535] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:220/7011
<4> [259.344616] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.344682] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.344687] CPU: 2 UID: 0 PID: 7011 Comm: kworker/u64:220 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.344690] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.344691] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.344693] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.344698] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.344763] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.344765] RSP: 0018:ffffc90007527ca0 EFLAGS: 00010246
<4> [259.344767] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.344769] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.344770] RBP: ffffc90007527db0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.344772] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.344773] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.344774] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [259.344776] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.344777] CR2: 00007d71ab715098 CR3: 000000000344c002 CR4: 0000000000f72ef0
<4> [259.344779] PKRU: 55555554
<4> [259.344780] Call Trace:
<4> [259.344781] <TASK>
<4> [259.344785] ? lock_acquire+0x20/0x2f0
<4> [259.344790] ? lock_release+0xd0/0x2b0
<4> [259.344796] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.344801] process_one_work+0x239/0x760
<4> [259.344808] worker_thread+0x200/0x3f0
<4> [259.344810] ? __pfx_worker_thread+0x10/0x10
<4> [259.344813] kthread+0x10d/0x150
<4> [259.344816] ? __pfx_kthread+0x10/0x10
<4> [259.344819] ret_from_fork+0x3d4/0x480
<4> [259.344821] ? __pfx_kthread+0x10/0x10
<4> [259.344825] ret_from_fork_asm+0x1a/0x30
<4> [259.344832] </TASK>
<4> [259.344833] irq event stamp: 417671
<4> [259.344834] hardirqs last enabled at (417677): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.344837] hardirqs last disabled at (417682): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.344839] softirqs last enabled at (416750): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.344842] softirqs last disabled at (416743): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.344844] ---[ end trace 0000000000000000 ]---
<6> [259.344846] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.344914] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.344920] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.345325] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.345525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.345617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.345703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.345783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.345862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.345939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.346017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.346098] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.346175] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.346267] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.346379] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.347381] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.357576] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.357852] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.358867] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.358943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.359013] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.359085] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.359157] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.359229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.359300] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.359371] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.359441] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.359510] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.359585] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.359655] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.359723] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.359788] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.359854] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.359923] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.359993] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.360062] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.360130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.360208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.360282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.360354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.360426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.360498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.360573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.360647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.360717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.360789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.360862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.360933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.361007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.361078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.361157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.361235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.361310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.361382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.361454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.361523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.361599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.361666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.361736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.361805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.361879] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.361950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.362024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.362093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.362165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.362231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.362301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.362368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.362435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.362505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.362581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.362649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.362715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.362783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.362851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.362917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.362987] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.363093] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.363945] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72322, lrc_seqno=72322, guc_id=0, flags=0x73 in no process [-1]
<7> [259.363948] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.364006] ------------[ cut here ]------------
<4> [259.364008] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.364009] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:220/7011
<4> [259.364076] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.364140] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.364145] CPU: 2 UID: 0 PID: 7011 Comm: kworker/u64:220 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.364147] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.364149] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.364150] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.364155] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.364221] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.364222] RSP: 0018:ffffc90007527ca0 EFLAGS: 00010246
<4> [259.364225] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.364226] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.364227] RBP: ffffc90007527db0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.364228] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.364230] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.364231] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [259.364232] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.364234] CR2: 00007d71ab715098 CR3: 000000000344c002 CR4: 0000000000f72ef0
<4> [259.364235] PKRU: 55555554
<4> [259.364236] Call Trace:
<4> [259.364238] <TASK>
<4> [259.364241] ? lock_acquire+0x20/0x2f0
<4> [259.364247] ? lock_release+0xd0/0x2b0
<4> [259.364252] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.364258] process_one_work+0x239/0x760
<4> [259.364264] worker_thread+0x200/0x3f0
<4> [259.364267] ? __pfx_worker_thread+0x10/0x10
<4> [259.364269] kthread+0x10d/0x150
<4> [259.364272] ? __pfx_kthread+0x10/0x10
<4> [259.364276] ret_from_fork+0x3d4/0x480
<4> [259.364278] ? __pfx_kthread+0x10/0x10
<4> [259.364281] ret_from_fork_asm+0x1a/0x30
<4> [259.364288] </TASK>
<4> [259.364289] irq event stamp: 420783
<4> [259.364291] hardirqs last enabled at (420789): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.364293] hardirqs last disabled at (420794): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.364295] softirqs last enabled at (419886): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.364298] softirqs last disabled at (419879): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.364300] ---[ end trace 0000000000000000 ]---
<7> [259.364581] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [259.364681] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [259.364846] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72377, lrc_seqno=72377, guc_id=0, flags=0x73 in no process [-1]
<7> [259.364848] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.364907] ------------[ cut here ]------------
<4> [259.364908] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.364909] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:220/7011
<4> [259.364977] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.365054] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.365059] CPU: 2 UID: 0 PID: 7011 Comm: kworker/u64:220 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.365062] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.365063] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.365065] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.365070] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.365139] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.365141] RSP: 0018:ffffc90007527ca0 EFLAGS: 00010246
<4> [259.365143] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.365145] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.365146] RBP: ffffc90007527db0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.365147] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.365149] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.365151] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [259.365152] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.365154] CR2: 00007d71ab715098 CR3: 000000000344c002 CR4: 0000000000f72ef0
<4> [259.365156] PKRU: 55555554
<4> [259.365157] Call Trace:
<4> [259.365158] <TASK>
<4> [259.365162] ? lock_acquire+0x20/0x2f0
<4> [259.365168] ? lock_release+0xd0/0x2b0
<4> [259.365173] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.365179] process_one_work+0x239/0x760
<4> [259.365185] worker_thread+0x200/0x3f0
<4> [259.365188] ? __pfx_worker_thread+0x10/0x10
<4> [259.365190] kthread+0x10d/0x150
<4> [259.365193] ? __pfx_kthread+0x10/0x10
<4> [259.365197] ret_from_fork+0x3d4/0x480
<4> [259.365199] ? __pfx_kthread+0x10/0x10
<4> [259.365203] ret_from_fork_asm+0x1a/0x30
<4> [259.365210] </TASK>
<4> [259.365212] irq event stamp: 422521
<4> [259.365213] hardirqs last enabled at (422527): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.365216] hardirqs last disabled at (422532): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.365219] softirqs last enabled at (419886): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.365221] softirqs last disabled at (419879): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.365224] ---[ end trace 0000000000000000 ]---
<6> [259.365226] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.365292] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.365298] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.365348] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.365556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.365683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.365792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.365875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.365956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.366035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.366113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.366194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.366271] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.366365] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.366475] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.367485] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.377573] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.377819] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.378836] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.378912] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.378985] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.379059] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.379131] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.379201] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.379270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.379340] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.379411] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.379480] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.379549] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.379633] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.379724] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.379794] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.379864] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.379931] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.379997] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.380063] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.380129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.380204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.380280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.380352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.380422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.380490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.380556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.380641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.380733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.380807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.380878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.380946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.381015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.381084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.381158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.381231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.381306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.381377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.381447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.381518] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.381597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.381689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.381763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.381835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.381905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.381974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.382045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.382113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.382181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.382248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.382315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.382380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.382445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.382513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.382586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.382673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.382741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.382810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.382876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.382942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.383012] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.383122] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.383126] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72377, lrc_seqno=72377, guc_id=0, flags=0x73 in no process [-1]
<7> [259.383129] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.383186] ------------[ cut here ]------------
<4> [259.383188] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.383189] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:218/7009
<4> [259.383256] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.383321] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.383326] CPU: 8 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.383329] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.383330] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.383332] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.383337] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.383403] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.383404] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [259.383407] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.383408] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.383409] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.383411] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.383412] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.383413] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [259.383415] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.383416] CR2: 000072daae116910 CR3: 0000000124092006 CR4: 0000000000f72ef0
<4> [259.383418] PKRU: 55555554
<4> [259.383419] Call Trace:
<4> [259.383420] <TASK>
<4> [259.383424] ? lock_acquire+0x20/0x2f0
<4> [259.383430] ? lock_release+0xd0/0x2b0
<4> [259.383435] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.383441] process_one_work+0x239/0x760
<4> [259.383447] worker_thread+0x200/0x3f0
<4> [259.383450] ? __pfx_worker_thread+0x10/0x10
<4> [259.383452] kthread+0x10d/0x150
<4> [259.383455] ? __pfx_kthread+0x10/0x10
<4> [259.383459] ret_from_fork+0x3d4/0x480
<4> [259.383461] ? __pfx_kthread+0x10/0x10
<4> [259.383464] ret_from_fork_asm+0x1a/0x30
<4> [259.383472] </TASK>
<4> [259.383473] irq event stamp: 236691
<4> [259.383474] hardirqs last enabled at (236697): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.383477] hardirqs last disabled at (236702): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.383479] softirqs last enabled at (235804): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.383482] softirqs last disabled at (235799): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.383484] ---[ end trace 0000000000000000 ]---
<6> [259.383486] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.383551] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.383557] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.384814] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [259.384916] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [259.385015] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.385224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.385316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.385408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.385491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.385576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.385653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.385731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.385812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.385889] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.385980] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.386092] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.387099] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.402570] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 14ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.402822] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.403861] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.403935] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.404005] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.404079] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.404148] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.404217] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.404287] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.404356] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.404426] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.404496] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.404569] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.404638] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.404706] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.404774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.404844] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.404911] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.404979] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.405046] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.405113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.405188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.405262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.405334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.405406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.405476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.405545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.405626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.405696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.405767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.405837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.405906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.405974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.406043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.406115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.406189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.406263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.406333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.406401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.406467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.406533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.406609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.406680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.406747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.406815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.406880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.406948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.407012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.407078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.407142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.407209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.407273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.407337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.407405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.407469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.407533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.407608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.407674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.407737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.407801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.407868] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.407977] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.407981] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72377, lrc_seqno=72377, guc_id=0, flags=0x73 in no process [-1]
<7> [259.407984] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.408040] ------------[ cut here ]------------
<4> [259.408041] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.408043] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:221/7012
<4> [259.408112] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.408178] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.408183] CPU: 6 UID: 0 PID: 7012 Comm: kworker/u64:221 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.408186] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.408187] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.408189] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.408194] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.408260] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.408262] RSP: 0018:ffffc9000752fca0 EFLAGS: 00010246
<4> [259.408264] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.408266] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.408267] RBP: ffffc9000752fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.408268] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.408269] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.408271] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [259.408273] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.408274] CR2: 0000614ba7466ac8 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [259.408276] PKRU: 55555554
<4> [259.408277] Call Trace:
<4> [259.408278] <TASK>
<4> [259.408282] ? lock_acquire+0x20/0x2f0
<4> [259.408287] ? lock_release+0xd0/0x2b0
<4> [259.408293] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.408298] process_one_work+0x239/0x760
<4> [259.408305] worker_thread+0x200/0x3f0
<4> [259.408307] ? __pfx_worker_thread+0x10/0x10
<4> [259.408310] kthread+0x10d/0x150
<4> [259.408312] ? __pfx_kthread+0x10/0x10
<4> [259.408316] ret_from_fork+0x3d4/0x480
<4> [259.408318] ? __pfx_kthread+0x10/0x10
<4> [259.408321] ret_from_fork_asm+0x1a/0x30
<4> [259.408329] </TASK>
<4> [259.408330] irq event stamp: 192791
<4> [259.408331] hardirqs last enabled at (192797): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.408334] hardirqs last disabled at (192802): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.408336] softirqs last enabled at (191918): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.408339] softirqs last disabled at (191909): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.408341] ---[ end trace 0000000000000000 ]---
<5> [259.409364] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72432, lrc_seqno=72432, guc_id=0, flags=0x73 in no process [-1]
<7> [259.409367] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.409428] ------------[ cut here ]------------
<4> [259.409429] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.409430] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:221/7012
<4> [259.409497] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.409564] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.409569] CPU: 6 UID: 0 PID: 7012 Comm: kworker/u64:221 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.409571] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.409572] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.409574] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.409578] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.409644] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.409646] RSP: 0018:ffffc9000752fca0 EFLAGS: 00010246
<4> [259.409648] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.409649] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.409650] RBP: ffffc9000752fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.409651] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.409653] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.409654] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [259.409655] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.409657] CR2: 0000614ba7466ac8 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [259.409658] PKRU: 55555554
<4> [259.409659] Call Trace:
<4> [259.409660] <TASK>
<4> [259.409664] ? lock_acquire+0x20/0x2f0
<4> [259.409669] ? lock_release+0xd0/0x2b0
<4> [259.409675] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.409680] process_one_work+0x239/0x760
<4> [259.409686] worker_thread+0x200/0x3f0
<4> [259.409688] ? __pfx_worker_thread+0x10/0x10
<4> [259.409690] kthread+0x10d/0x150
<4> [259.409693] ? __pfx_kthread+0x10/0x10
<4> [259.409697] ret_from_fork+0x3d4/0x480
<4> [259.409699] ? __pfx_kthread+0x10/0x10
<4> [259.409702] ret_from_fork_asm+0x1a/0x30
<4> [259.409709] </TASK>
<4> [259.409710] irq event stamp: 194151
<4> [259.409712] hardirqs last enabled at (194157): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.409714] hardirqs last disabled at (194162): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.409716] softirqs last enabled at (191918): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.409719] softirqs last disabled at (191909): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.409721] ---[ end trace 0000000000000000 ]---
<7> [259.409733] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [259.409831] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<6> [259.409923] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.409989] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.409995] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.410062] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.410264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.410352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.410440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.410523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.410680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.410763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.410842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.410923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.411001] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.411093] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.411204] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.412215] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.422568] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.423149] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.424169] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.424245] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.424317] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.424390] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.424461] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.424529] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.424611] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.424703] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.424775] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.424845] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.424913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.424980] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.425047] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.425116] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.425182] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.425248] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.425315] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.425382] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.425448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.425523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.425614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.425710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.425784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.425855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.425925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.425994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.426063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.426134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.426205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.426274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.426343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.426415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.426491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.426575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.426669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.426741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.426812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.426882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.426951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.427018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.427088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.427156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.427226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.427294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.427365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.427432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.427498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.427569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.427670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.427744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.427816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.427889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.427959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.428031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.428099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.428169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.428238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.428307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.428380] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.428489] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.428494] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72432, lrc_seqno=72432, guc_id=0, flags=0x73 in no process [-1]
<7> [259.428496] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.428553] ------------[ cut here ]------------
<4> [259.428554] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.428556] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:218/7009
<4> [259.428644] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.428745] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.428750] CPU: 8 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.428753] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.428755] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.428756] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.428761] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.428826] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.428828] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [259.428830] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.428831] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.428833] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.428834] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.428835] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.428837] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [259.428838] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.428840] CR2: 000072daae116910 CR3: 0000000124092006 CR4: 0000000000f72ef0
<4> [259.428841] PKRU: 55555554
<4> [259.428842] Call Trace:
<4> [259.428843] <TASK>
<4> [259.428847] ? lock_acquire+0x20/0x2f0
<4> [259.428853] ? lock_release+0xd0/0x2b0
<4> [259.428858] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.428864] process_one_work+0x239/0x760
<4> [259.428870] worker_thread+0x200/0x3f0
<4> [259.428873] ? __pfx_worker_thread+0x10/0x10
<4> [259.428875] kthread+0x10d/0x150
<4> [259.428878] ? __pfx_kthread+0x10/0x10
<4> [259.428882] ret_from_fork+0x3d4/0x480
<4> [259.428884] ? __pfx_kthread+0x10/0x10
<4> [259.428887] ret_from_fork_asm+0x1a/0x30
<4> [259.428895] </TASK>
<4> [259.428896] irq event stamp: 242327
<4> [259.428897] hardirqs last enabled at (242333): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.428900] hardirqs last disabled at (242338): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.428902] softirqs last enabled at (241578): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.428904] softirqs last disabled at (241573): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.428907] ---[ end trace 0000000000000000 ]---
<6> [259.428909] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.428975] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.428981] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.430220] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [259.430318] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [259.430415] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.430621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.430707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.430792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.430874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.430953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.431032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.431110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.431190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.431266] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.431355] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.431466] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.432467] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.442564] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.442813] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.444038] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.444114] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.444181] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.444246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.444310] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.444373] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.444436] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.444498] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.444565] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.444632] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.444699] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.444766] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.444833] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.444900] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.444968] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.445033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.445100] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.445168] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.445237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.445313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.445388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.445460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.445533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.445615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.445684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.445756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.445828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.445903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.445975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.446045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.446117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.446186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.446260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.446335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.446409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.446481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.446552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.446640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.446714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.446784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.446855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.446928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.446997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.447064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.447137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.447206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.447275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.447343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.447414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.447482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.447550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.447636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.447707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.447775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.447843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.447912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.447982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.448050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.448121] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.448230] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.448233] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72432, lrc_seqno=72432, guc_id=0, flags=0x73 in no process [-1]
<7> [259.448236] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.448293] ------------[ cut here ]------------
<4> [259.448294] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.448296] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:221/7012
<4> [259.448365] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.448430] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.448435] CPU: 6 UID: 0 PID: 7012 Comm: kworker/u64:221 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.448437] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.448439] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.448440] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.448445] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.448512] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.448514] RSP: 0018:ffffc9000752fca0 EFLAGS: 00010246
<4> [259.448516] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.448518] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.448519] RBP: ffffc9000752fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.448520] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.448521] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.448523] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [259.448524] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.448526] CR2: 0000614ba7466ac8 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [259.448527] PKRU: 55555554
<4> [259.448528] Call Trace:
<4> [259.448529] <TASK>
<4> [259.448533] ? lock_acquire+0x20/0x2f0
<4> [259.448539] ? lock_release+0xd0/0x2b0
<4> [259.448544] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.448550] process_one_work+0x239/0x760
<4> [259.448559] worker_thread+0x200/0x3f0
<4> [259.448562] ? __pfx_worker_thread+0x10/0x10
<4> [259.448565] kthread+0x10d/0x150
<4> [259.448568] ? __pfx_kthread+0x10/0x10
<4> [259.448571] ret_from_fork+0x3d4/0x480
<4> [259.448573] ? __pfx_kthread+0x10/0x10
<4> [259.448577] ret_from_fork_asm+0x1a/0x30
<4> [259.448584] </TASK>
<4> [259.448586] irq event stamp: 197681
<4> [259.448587] hardirqs last enabled at (197687): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.448590] hardirqs last disabled at (197692): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.448592] softirqs last enabled at (196578): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.448594] softirqs last disabled at (196569): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.448596] ---[ end trace 0000000000000000 ]---
<5> [259.450112] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72487, lrc_seqno=72487, guc_id=0, flags=0x73 in no process [-1]
<7> [259.450115] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.450176] ------------[ cut here ]------------
<4> [259.450177] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.450178] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:221/7012
<4> [259.450244] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.450308] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.450312] CPU: 6 UID: 0 PID: 7012 Comm: kworker/u64:221 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.450315] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.450316] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.450317] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.450322] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.450387] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.450388] RSP: 0018:ffffc9000752fca0 EFLAGS: 00010246
<4> [259.450390] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.450392] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.450393] RBP: ffffc9000752fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.450394] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.450395] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.450397] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [259.450398] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.450399] CR2: 0000614ba7466ac8 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [259.450401] PKRU: 55555554
<4> [259.450402] Call Trace:
<4> [259.450403] <TASK>
<4> [259.450407] ? lock_acquire+0x20/0x2f0
<4> [259.450412] ? lock_release+0xd0/0x2b0
<4> [259.450417] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.450422] process_one_work+0x239/0x760
<4> [259.450428] worker_thread+0x200/0x3f0
<4> [259.450431] ? __pfx_worker_thread+0x10/0x10
<4> [259.450433] kthread+0x10d/0x150
<4> [259.450436] ? __pfx_kthread+0x10/0x10
<4> [259.450440] ret_from_fork+0x3d4/0x480
<4> [259.450442] ? __pfx_kthread+0x10/0x10
<4> [259.450445] ret_from_fork_asm+0x1a/0x30
<4> [259.450452] </TASK>
<4> [259.450453] irq event stamp: 200379
<4> [259.450454] hardirqs last enabled at (200385): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.450457] hardirqs last disabled at (200390): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.450459] softirqs last enabled at (196578): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.450462] softirqs last disabled at (196569): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.450464] ---[ end trace 0000000000000000 ]---
<6> [259.450465] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.450530] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.450536] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.450549] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [259.450666] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [259.450790] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.451017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.451105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.451193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.451274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.451353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.451430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.451508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.451613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.451692] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.451782] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.451892] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.452902] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.463565] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.463813] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.465085] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.465160] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.465232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.465303] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.465374] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.465444] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.465512] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.465593] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.465677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.465748] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.465816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.465883] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.465950] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.466019] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.466085] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.466154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.466219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.466287] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.466355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.466430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.466504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.466585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.466683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.466757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.466828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.466897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.466964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.467033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.467103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.467170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.467238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.467306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.467379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.467456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.467532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.467619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.467715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.467787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.467857] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.467925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.467995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.468063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.468131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.468198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.468267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.468334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.468401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.468465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.468533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.468615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.468705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.468779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.468848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.468916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.468982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.469048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.469113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.469177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.469245] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.469354] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.469358] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72487, lrc_seqno=72487, guc_id=0, flags=0x73 in no process [-1]
<7> [259.469360] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.469418] ------------[ cut here ]------------
<4> [259.469419] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.469420] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:218/7009
<4> [259.469488] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.469559] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.469566] CPU: 8 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.469569] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.469570] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.469571] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.469579] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.469672] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.469674] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [259.469676] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.469678] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.469679] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.469680] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.469682] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.469683] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [259.469685] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.469686] CR2: 000072daae116910 CR3: 0000000124092006 CR4: 0000000000f72ef0
<4> [259.469688] PKRU: 55555554
<4> [259.469689] Call Trace:
<4> [259.469690] <TASK>
<4> [259.469694] ? lock_acquire+0x20/0x2f0
<4> [259.469699] ? lock_release+0xd0/0x2b0
<4> [259.469705] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.469711] process_one_work+0x239/0x760
<4> [259.469717] worker_thread+0x200/0x3f0
<4> [259.469720] ? __pfx_worker_thread+0x10/0x10
<4> [259.469722] kthread+0x10d/0x150
<4> [259.469725] ? __pfx_kthread+0x10/0x10
<4> [259.469729] ret_from_fork+0x3d4/0x480
<4> [259.469731] ? __pfx_kthread+0x10/0x10
<4> [259.469734] ret_from_fork_asm+0x1a/0x30
<4> [259.469741] </TASK>
<4> [259.469742] irq event stamp: 247749
<4> [259.469744] hardirqs last enabled at (247755): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.469746] hardirqs last disabled at (247760): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.469749] softirqs last enabled at (246740): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.469751] softirqs last disabled at (246733): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.469753] ---[ end trace 0000000000000000 ]---
<6> [259.469755] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.469821] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.469827] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.470231] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.470428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.470508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.470610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.470719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.470797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.470873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.470950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.471029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.471102] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.471191] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.471301] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.472313] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.482915] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.483153] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.484392] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.484466] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.484537] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.484627] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.484725] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.484798] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.484869] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.484939] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.485008] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.485076] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.485144] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.485211] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.485279] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.485347] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.485415] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.485482] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.485548] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.485633] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.485722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.485800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.485873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.485946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.486019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.486090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.486161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.486230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.486297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.486367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.486438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.486506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.486586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.486679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.486754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.486829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.486903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.486976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.487045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.487112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.487183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.487252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.487322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.487391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.487459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.487525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.487608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.487696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.487765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.487831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.487898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.487965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.488033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.488102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.488170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.488238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.488303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.488370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.488434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.488498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.488572] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.488705] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.488709] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72487, lrc_seqno=72487, guc_id=0, flags=0x73 in no process [-1]
<7> [259.488712] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.488769] ------------[ cut here ]------------
<4> [259.488770] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.488771] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:218/7009
<4> [259.488839] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.488903] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.488908] CPU: 8 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.488911] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.488912] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.488913] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.488918] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.488984] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.488985] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [259.488987] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.488989] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.488990] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.488991] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.488993] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.488994] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [259.488995] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.488997] CR2: 000072daae116910 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [259.488998] PKRU: 55555554
<4> [259.489000] Call Trace:
<4> [259.489001] <TASK>
<4> [259.489005] ? lock_acquire+0x20/0x2f0
<4> [259.489010] ? lock_release+0xd0/0x2b0
<4> [259.489015] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.489021] process_one_work+0x239/0x760
<4> [259.489027] worker_thread+0x200/0x3f0
<4> [259.489030] ? __pfx_worker_thread+0x10/0x10
<4> [259.489032] kthread+0x10d/0x150
<4> [259.489035] ? __pfx_kthread+0x10/0x10
<4> [259.489039] ret_from_fork+0x3d4/0x480
<4> [259.489040] ? __pfx_kthread+0x10/0x10
<4> [259.489044] ret_from_fork_asm+0x1a/0x30
<4> [259.489051] </TASK>
<4> [259.489052] irq event stamp: 250891
<4> [259.489053] hardirqs last enabled at (250897): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.489056] hardirqs last disabled at (250902): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.489058] softirqs last enabled at (249836): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.489061] softirqs last disabled at (249829): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.489063] ---[ end trace 0000000000000000 ]---
<5> [259.490358] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72542, lrc_seqno=72542, guc_id=0, flags=0x73 in no process [-1]
<7> [259.490361] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.490420] ------------[ cut here ]------------
<4> [259.490421] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.490423] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:218/7009
<4> [259.490490] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.490559] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.490565] CPU: 8 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.490569] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.490571] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.490573] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.490581] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.490667] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.490669] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [259.490671] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.490672] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.490674] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.490675] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.490676] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.490677] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [259.490679] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.490680] CR2: 000072daae116910 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [259.490682] PKRU: 55555554
<4> [259.490683] Call Trace:
<4> [259.490684] <TASK>
<4> [259.490687] ? lock_acquire+0x20/0x2f0
<4> [259.490692] ? lock_release+0xd0/0x2b0
<4> [259.490698] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.490703] process_one_work+0x239/0x760
<4> [259.490709] worker_thread+0x200/0x3f0
<4> [259.490712] ? __pfx_worker_thread+0x10/0x10
<4> [259.490715] kthread+0x10d/0x150
<4> [259.490717] ? __pfx_kthread+0x10/0x10
<4> [259.490721] ret_from_fork+0x3d4/0x480
<4> [259.490723] ? __pfx_kthread+0x10/0x10
<4> [259.490726] ret_from_fork_asm+0x1a/0x30
<4> [259.490733] </TASK>
<4> [259.490735] irq event stamp: 253067
<4> [259.490736] hardirqs last enabled at (253073): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.490738] hardirqs last disabled at (253078): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.490740] softirqs last enabled at (249836): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.490743] softirqs last disabled at (249829): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.490745] ---[ end trace 0000000000000000 ]---
<7> [259.490758] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [259.490855] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<6> [259.490948] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.491019] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.491024] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.491266] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.491470] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.491561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.491648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.491731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.491810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.491888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.491967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.492048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.492123] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.492212] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.492321] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.493325] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.503583] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.503829] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.505100] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.505173] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.505244] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.505316] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.505389] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.505458] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.505526] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.505604] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.505671] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.505739] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.505808] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.505877] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.505945] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.506014] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.506083] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.506153] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.506221] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.506289] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.506356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.506432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.506506] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.506591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.506669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.506742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.506811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.506880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.506948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.507020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.507092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.507162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.507232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.507302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.507376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.507449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.507522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.507611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.507682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.507752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.507821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.507889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.507959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.508029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.508097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.508163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.508235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.508302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.508370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.508438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.508505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.508579] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.508646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.508716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.508786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.508853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.508919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.508987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.509054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.509121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.509192] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.509301] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.509305] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72542, lrc_seqno=72542, guc_id=0, flags=0x73 in no process [-1]
<7> [259.509307] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.509364] ------------[ cut here ]------------
<4> [259.509365] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.509366] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:221/7012
<4> [259.509434] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.509498] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.509503] CPU: 6 UID: 0 PID: 7012 Comm: kworker/u64:221 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.509505] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.509507] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.509508] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.509513] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.509588] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.509590] RSP: 0018:ffffc9000752fca0 EFLAGS: 00010246
<4> [259.509592] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.509594] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.509595] RBP: ffffc9000752fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.509597] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.509598] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.509599] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [259.509601] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.509603] CR2: 0000614ba7466ac8 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [259.509604] PKRU: 55555554
<4> [259.509605] Call Trace:
<4> [259.509607] <TASK>
<4> [259.509610] ? lock_acquire+0x20/0x2f0
<4> [259.509616] ? lock_release+0xd0/0x2b0
<4> [259.509621] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.509627] process_one_work+0x239/0x760
<4> [259.509633] worker_thread+0x200/0x3f0
<4> [259.509636] ? __pfx_worker_thread+0x10/0x10
<4> [259.509638] kthread+0x10d/0x150
<4> [259.509641] ? __pfx_kthread+0x10/0x10
<4> [259.509645] ret_from_fork+0x3d4/0x480
<4> [259.509647] ? __pfx_kthread+0x10/0x10
<4> [259.509650] ret_from_fork_asm+0x1a/0x30
<4> [259.509657] </TASK>
<4> [259.509659] irq event stamp: 206109
<4> [259.509660] hardirqs last enabled at (206115): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.509663] hardirqs last disabled at (206120): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.509665] softirqs last enabled at (205200): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.509667] softirqs last disabled at (205193): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.509670] ---[ end trace 0000000000000000 ]---
<6> [259.510599] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.510669] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.510675] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.510727] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [259.510824] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [259.510924] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.511127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.511213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.511302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.511383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.511463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.511542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.511659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.511743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.511819] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.511908] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.512019] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.513028] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.523558] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.523805] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.525108] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.525177] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.525241] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.525306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.525370] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.525432] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.525494] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.525577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.525658] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.525726] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.525792] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.525861] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.525929] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.525996] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.526063] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.526131] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.526196] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.526262] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.526329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.526405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.526479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.526559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.526656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.526728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.526800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.526870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.526939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.527009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.527080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.527149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.527219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.527289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.527366] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.527439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.527513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.527596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.527690] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.527760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.527830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.527898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.527968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.528037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.528102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.528167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.528236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.528304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.528372] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.528439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.528508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.528590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.528680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.528750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.528818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.528884] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.528950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.529018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.529082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.529149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.529219] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.529328] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.529332] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72542, lrc_seqno=72542, guc_id=0, flags=0x73 in no process [-1]
<7> [259.529335] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.529391] ------------[ cut here ]------------
<4> [259.529392] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.529394] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:218/7009
<4> [259.529464] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.529528] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.529532] CPU: 8 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.529535] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.529537] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.529538] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.529543] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.529627] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.529629] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [259.529632] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.529634] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.529635] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.529636] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.529638] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.529639] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [259.529641] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.529642] CR2: 000072daae116910 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [259.529644] PKRU: 55555554
<4> [259.529645] Call Trace:
<4> [259.529647] <TASK>
<4> [259.529654] ? lock_acquire+0x20/0x2f0
<4> [259.529663] ? lock_release+0xd0/0x2b0
<4> [259.529673] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.529683] process_one_work+0x239/0x760
<4> [259.529695] worker_thread+0x200/0x3f0
<4> [259.529700] ? __pfx_worker_thread+0x10/0x10
<4> [259.529704] kthread+0x10d/0x150
<4> [259.529708] ? __pfx_kthread+0x10/0x10
<4> [259.529714] ret_from_fork+0x3d4/0x480
<4> [259.529718] ? __pfx_kthread+0x10/0x10
<4> [259.529723] ret_from_fork_asm+0x1a/0x30
<4> [259.529737] </TASK>
<4> [259.529739] irq event stamp: 256611
<4> [259.529741] hardirqs last enabled at (256617): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.529746] hardirqs last disabled at (256622): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.529749] softirqs last enabled at (255702): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.529752] softirqs last disabled at (255675): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.529754] ---[ end trace 0000000000000000 ]---
<5> [259.531503] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72597, lrc_seqno=72597, guc_id=0, flags=0x73 in no process [-1]
<7> [259.531507] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<7> [259.531526] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<4> [259.531589] ------------[ cut here ]------------
<4> [259.531591] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.531593] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:220/7011
<4> [259.531673] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi
<7> [259.531646] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<4> [259.531702] mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.531743] CPU: 2 UID: 0 PID: 7011 Comm: kworker/u64:220 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.531745] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.531747] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.531749] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.531754] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.531821] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.531823] RSP: 0018:ffffc90007527ca0 EFLAGS: 00010246
<4> [259.531825] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.531826] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.531827] RBP: ffffc90007527db0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.531829] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.531830] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.531831] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [259.531833] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.531834] CR2: 00007d71ab715098 CR3: 000000000344c002 CR4: 0000000000f72ef0
<4> [259.531836] PKRU: 55555554
<4> [259.531837] Call Trace:
<4> [259.531838] <TASK>
<4> [259.531842] ? lock_acquire+0x20/0x2f0
<4> [259.531847] ? lock_release+0xd0/0x2b0
<4> [259.531852] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.531858] process_one_work+0x239/0x760
<4> [259.531864] worker_thread+0x200/0x3f0
<4> [259.531867] ? __pfx_worker_thread+0x10/0x10
<4> [259.531869] kthread+0x10d/0x150
<4> [259.531872] ? __pfx_kthread+0x10/0x10
<4> [259.531876] ret_from_fork+0x3d4/0x480
<4> [259.531878] ? __pfx_kthread+0x10/0x10
<4> [259.531881] ret_from_fork_asm+0x1a/0x30
<4> [259.531888] </TASK>
<4> [259.531889] irq event stamp: 425819
<4> [259.531890] hardirqs last enabled at (425825): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.531893] hardirqs last disabled at (425830): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.531895] softirqs last enabled at (425048): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.531898] softirqs last disabled at (425043): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.531900] ---[ end trace 0000000000000000 ]---
<6> [259.531902] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.531967] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.531974] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.532021] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.532225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.532309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.532398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.532482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.532569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.532682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.532772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.532854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.532930] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.533018] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.533129] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.534139] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.544555] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.544802] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.546065] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.546140] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.546211] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.546283] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.546355] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.546426] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.546497] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.546577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.546661] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.546730] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.546798] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.546866] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.546933] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.547000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.547066] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.547132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.547197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.547262] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.547326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.547400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.547473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.547544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.547634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.547729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.547802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.547872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.547941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.548015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.548088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.548160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.548232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.548304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.548381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.548458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.548535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.548626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.548721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.548793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.548865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.548932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.549001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.549069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.549137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.549203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.549272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.549340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.549409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.549477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.549551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.549641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.549711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.549783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.549850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.549920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.549986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.550054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.550122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.550189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.550258] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.550368] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.550373] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72597, lrc_seqno=72597, guc_id=0, flags=0x73 in no process [-1]
<7> [259.550375] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.550433] ------------[ cut here ]------------
<4> [259.550434] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.550435] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:218/7009
<4> [259.550507] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.550593] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.550602] CPU: 8 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.550606] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.550608] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.550611] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.550619] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.550688] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.550690] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [259.550692] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.550694] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.550695] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.550696] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.550697] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.550699] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [259.550700] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.550702] CR2: 000072daae116910 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [259.550703] PKRU: 55555554
<4> [259.550704] Call Trace:
<4> [259.550705] <TASK>
<4> [259.550709] ? lock_acquire+0x20/0x2f0
<4> [259.550715] ? lock_release+0xd0/0x2b0
<4> [259.550720] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.550725] process_one_work+0x239/0x760
<4> [259.550732] worker_thread+0x200/0x3f0
<4> [259.550735] ? __pfx_worker_thread+0x10/0x10
<4> [259.550737] kthread+0x10d/0x150
<4> [259.550740] ? __pfx_kthread+0x10/0x10
<4> [259.550743] ret_from_fork+0x3d4/0x480
<4> [259.550745] ? __pfx_kthread+0x10/0x10
<4> [259.550749] ret_from_fork_asm+0x1a/0x30
<4> [259.550756] </TASK>
<4> [259.550757] irq event stamp: 261555
<4> [259.550758] hardirqs last enabled at (261561): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.550761] hardirqs last disabled at (261566): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.550763] softirqs last enabled at (260446): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.550766] softirqs last disabled at (260439): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.550768] ---[ end trace 0000000000000000 ]---
<6> [259.551561] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.551691] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.551696] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.551840] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [259.551938] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [259.552036] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.552240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.552327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.552415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.552496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.552585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.552665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.552745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.552825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.552901] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.552991] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.553102] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.554103] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.564813] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.565052] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.566310] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.566385] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.566455] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.566525] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.566607] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.566679] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.566749] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.566817] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.566885] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.566953] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.567020] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.567087] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.567154] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.567223] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.567291] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.567360] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.567428] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.567496] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.567568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.567646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.567721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.567793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.567867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.567936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.568007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.568076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.568145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.568219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.568291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.568363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.568434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.568503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.568586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.568661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.568735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.568806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.568877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.568947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.569015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.569082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.569151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.569222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.569289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.569361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.569437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.569507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.569586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.569658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.569727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.569795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.569864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.569935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.570003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.570070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.570138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.570207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.570275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.570342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.570413] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.570523] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.570527] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72597, lrc_seqno=72597, guc_id=0, flags=0x73 in no process [-1]
<7> [259.570529] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.570605] ------------[ cut here ]------------
<4> [259.570606] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.570608] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:221/7012
<4> [259.570676] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.570740] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.570745] CPU: 6 UID: 0 PID: 7012 Comm: kworker/u64:221 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.570748] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.570749] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.570750] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.570756] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.570823] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.570825] RSP: 0018:ffffc9000752fca0 EFLAGS: 00010246
<4> [259.570827] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.570828] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.570830] RBP: ffffc9000752fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.570831] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.570832] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.570833] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [259.570835] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.570836] CR2: 0000614ba7466ac8 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [259.570838] PKRU: 55555554
<4> [259.570839] Call Trace:
<4> [259.570840] <TASK>
<4> [259.570844] ? lock_acquire+0x20/0x2f0
<4> [259.570850] ? lock_release+0xd0/0x2b0
<4> [259.570855] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.570860] process_one_work+0x239/0x760
<4> [259.570866] worker_thread+0x200/0x3f0
<4> [259.570869] ? __pfx_worker_thread+0x10/0x10
<4> [259.570872] kthread+0x10d/0x150
<4> [259.570874] ? __pfx_kthread+0x10/0x10
<4> [259.570878] ret_from_fork+0x3d4/0x480
<4> [259.570880] ? __pfx_kthread+0x10/0x10
<4> [259.570883] ret_from_fork_asm+0x1a/0x30
<4> [259.570890] </TASK>
<4> [259.570892] irq event stamp: 209539
<4> [259.570893] hardirqs last enabled at (209545): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.570895] hardirqs last disabled at (209550): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.570898] softirqs last enabled at (208612): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.570900] softirqs last disabled at (208605): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.570902] ---[ end trace 0000000000000000 ]---
<5> [259.572421] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72652, lrc_seqno=72652, guc_id=0, flags=0x73 in no process [-1]
<7> [259.572424] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.572485] ------------[ cut here ]------------
<4> [259.572486] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.572488] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:221/7012
<4> [259.572562] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.572626] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.572630] CPU: 6 UID: 0 PID: 7012 Comm: kworker/u64:221 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.572633] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.572634] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.572635] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.572640] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.572707] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.572708] RSP: 0018:ffffc9000752fca0 EFLAGS: 00010246
<4> [259.572710] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.572712] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.572713] RBP: ffffc9000752fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.572714] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.572715] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.572717] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [259.572718] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.572719] CR2: 0000614ba7466ac8 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [259.572721] PKRU: 55555554
<4> [259.572722] Call Trace:
<4> [259.572723] <TASK>
<4> [259.572727] ? lock_acquire+0x20/0x2f0
<4> [259.572732] ? lock_release+0xd0/0x2b0
<4> [259.572737] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.572743] process_one_work+0x239/0x760
<4> [259.572748] worker_thread+0x200/0x3f0
<4> [259.572751] ? __pfx_worker_thread+0x10/0x10
<4> [259.572754] kthread+0x10d/0x150
<4> [259.572756] ? __pfx_kthread+0x10/0x10
<4> [259.572760] ret_from_fork+0x3d4/0x480
<4> [259.572762] ? __pfx_kthread+0x10/0x10
<4> [259.572765] ret_from_fork_asm+0x1a/0x30
<4> [259.572772] </TASK>
<4> [259.572774] irq event stamp: 212227
<4> [259.572775] hardirqs last enabled at (212233): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.572777] hardirqs last disabled at (212238): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.572779] softirqs last enabled at (208612): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.572782] softirqs last disabled at (208605): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.572784] ---[ end trace 0000000000000000 ]---
<7> [259.572796] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [259.572892] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<6> [259.572984] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.573050] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.573056] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.573104] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.573310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.573397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.573484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.573570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.573685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.573766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.573845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.573927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.574002] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.574091] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.574201] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.575212] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.585550] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.585796] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.587057] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.587132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.587204] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.587274] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.587342] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.587410] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.587478] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.587613] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.587684] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.587752] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.587820] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.587887] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.587955] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.588022] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.588088] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.588155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.588224] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.588291] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.588358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.588433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.588507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.588592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.588682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.588753] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.588822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.588890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.588957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.589026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.589095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.589163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.589232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.589301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.589376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.589451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.589524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.589609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.589703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.589774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.589842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.589910] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.589981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.590051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.590119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.590186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.590260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.590329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.590399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.590467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.590536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.590621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.590712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.590785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.590852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.590920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.590986] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.591053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.591118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.591182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.591250] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.591360] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.591364] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72652, lrc_seqno=72652, guc_id=0, flags=0x73 in no process [-1]
<7> [259.591366] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.591423] ------------[ cut here ]------------
<4> [259.591424] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.591425] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:220/7011
<4> [259.591493] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.591568] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.591576] CPU: 8 UID: 0 PID: 7011 Comm: kworker/u64:220 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.591580] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.591582] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.591584] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.591593] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.591670] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.591671] RSP: 0018:ffffc90007527ca0 EFLAGS: 00010246
<4> [259.591674] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.591675] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.591677] RBP: ffffc90007527db0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.591678] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.591679] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.591680] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [259.591682] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.591683] CR2: 000072daae116910 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [259.591685] PKRU: 55555554
<4> [259.591686] Call Trace:
<4> [259.591687] <TASK>
<4> [259.591691] ? lock_acquire+0x20/0x2f0
<4> [259.591696] ? lock_release+0xd0/0x2b0
<4> [259.591702] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.591707] process_one_work+0x239/0x760
<4> [259.591714] worker_thread+0x200/0x3f0
<4> [259.591716] ? __pfx_worker_thread+0x10/0x10
<4> [259.591719] kthread+0x10d/0x150
<4> [259.591722] ? __pfx_kthread+0x10/0x10
<4> [259.591725] ret_from_fork+0x3d4/0x480
<4> [259.591727] ? __pfx_kthread+0x10/0x10
<4> [259.591730] ret_from_fork_asm+0x1a/0x30
<4> [259.591738] </TASK>
<4> [259.591739] irq event stamp: 431337
<4> [259.591740] hardirqs last enabled at (431343): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.591743] hardirqs last disabled at (431348): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.591745] softirqs last enabled at (430222): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.591748] softirqs last disabled at (430213): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.591750] ---[ end trace 0000000000000000 ]---
<6> [259.591752] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.591817] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.591823] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.593099] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [259.593198] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [259.593296] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.593502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.593616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.593708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.593790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.593870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.593949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.594029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.594108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.594183] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.594274] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.594388] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.595396] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.605548] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.605802] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.607047] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.607124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.607198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.607271] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.607343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.607413] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.607482] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.607562] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.607645] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.607717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.607787] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.607855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.607921] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.607987] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.608053] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.608122] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.608190] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.608255] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.608320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.608397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.608472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.608555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.608640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.608711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.608781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.608850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.608919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.608991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.609064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.609135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.609206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.609279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.609357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.609432] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.609507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.609599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.609682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.609751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.609818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.609885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.609957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.610027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.610096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.610162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.610235] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.610304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.610369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.610433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.610502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.610582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.610664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.610737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.610806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.610875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.610942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.611012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.611078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.611145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.611216] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.611325] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.611329] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72652, lrc_seqno=72652, guc_id=0, flags=0x73 in no process [-1]
<7> [259.611332] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.611390] ------------[ cut here ]------------
<4> [259.611391] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.611392] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:218/7009
<4> [259.611462] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.611527] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.611531] CPU: 2 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.611534] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.611535] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.611537] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.611549] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.611631] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.611633] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [259.611635] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.611637] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.611638] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.611639] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.611641] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.611642] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [259.611643] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.611645] CR2: 00007d71ab715098 CR3: 000000000344c002 CR4: 0000000000f72ef0
<4> [259.611646] PKRU: 55555554
<4> [259.611648] Call Trace:
<4> [259.611649] <TASK>
<4> [259.611653] ? lock_acquire+0x20/0x2f0
<4> [259.611658] ? lock_release+0xd0/0x2b0
<4> [259.611664] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.611669] process_one_work+0x239/0x760
<4> [259.611675] worker_thread+0x200/0x3f0
<4> [259.611678] ? __pfx_worker_thread+0x10/0x10
<4> [259.611681] kthread+0x10d/0x150
<4> [259.611683] ? __pfx_kthread+0x10/0x10
<4> [259.611687] ret_from_fork+0x3d4/0x480
<4> [259.611689] ? __pfx_kthread+0x10/0x10
<4> [259.611692] ret_from_fork_asm+0x1a/0x30
<4> [259.611700] </TASK>
<4> [259.611701] irq event stamp: 265073
<4> [259.611702] hardirqs last enabled at (265079): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.611705] hardirqs last disabled at (265084): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.611707] softirqs last enabled at (263958): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.611709] softirqs last disabled at (263951): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.611712] ---[ end trace 0000000000000000 ]---
<7> [259.613267] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [259.613366] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [259.613458] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72707, lrc_seqno=72707, guc_id=0, flags=0x73 in no process [-1]
<7> [259.613460] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.613519] ------------[ cut here ]------------
<4> [259.613520] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.613522] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:218/7009
<4> [259.613612] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.613700] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.613706] CPU: 2 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.613709] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.613711] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.613712] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.613718] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.613787] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.613788] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [259.613791] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.613793] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.613795] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.613796] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.613798] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.613799] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [259.613801] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.613803] CR2: 00007d71ab715098 CR3: 000000000344c002 CR4: 0000000000f72ef0
<4> [259.613805] PKRU: 55555554
<4> [259.613806] Call Trace:
<4> [259.613808] <TASK>
<4> [259.613812] ? lock_acquire+0x20/0x2f0
<4> [259.613817] ? lock_release+0xd0/0x2b0
<4> [259.613823] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.613828] process_one_work+0x239/0x760
<4> [259.613835] worker_thread+0x200/0x3f0
<4> [259.613838] ? __pfx_worker_thread+0x10/0x10
<4> [259.613841] kthread+0x10d/0x150
<4> [259.613844] ? __pfx_kthread+0x10/0x10
<4> [259.613847] ret_from_fork+0x3d4/0x480
<4> [259.613850] ? __pfx_kthread+0x10/0x10
<4> [259.613853] ret_from_fork_asm+0x1a/0x30
<4> [259.613861] </TASK>
<4> [259.613862] irq event stamp: 267793
<4> [259.613864] hardirqs last enabled at (267799): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.613867] hardirqs last disabled at (267804): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.613869] softirqs last enabled at (267044): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.613872] softirqs last disabled at (267033): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.613875] ---[ end trace 0000000000000000 ]---
<6> [259.613877] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.613944] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.613950] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.613997] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.614197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.614282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.614368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.614448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.614528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.614627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.614733] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.614816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.614892] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.614984] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.615095] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.616105] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.626546] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.626818] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.628124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.628199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.628269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.628341] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.628411] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.628481] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.628558] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.628640] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.628709] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.628778] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.628847] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.628914] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.628981] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.629048] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.629115] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.629184] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.629252] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.629320] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.629388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.629464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.629546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.629648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.629722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.629793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.629862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.629931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.630000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.630071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.630142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.630215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.630287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.630358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.630436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.630513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.630602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.630686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.630757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.630827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.630898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.630968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.631042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.631115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.631186] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.631255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.631328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.631397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.631466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.631533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.631623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.631703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.631771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.631841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.631909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.631977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.632044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.632115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.632181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.632250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.632323] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.632433] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.632436] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72707, lrc_seqno=72707, guc_id=0, flags=0x73 in no process [-1]
<7> [259.632439] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.632496] ------------[ cut here ]------------
<4> [259.632497] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.632498] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:218/7009
<4> [259.632591] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.632676] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.632680] CPU: 2 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.632685] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.632686] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.632687] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.632692] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.632760] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.632762] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [259.632764] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.632765] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.632766] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.632768] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.632769] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.632770] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [259.632772] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.632773] CR2: 00007d71ab715098 CR3: 000000000344c002 CR4: 0000000000f72ef0
<4> [259.632775] PKRU: 55555554
<4> [259.632776] Call Trace:
<4> [259.632777] <TASK>
<4> [259.632780] ? lock_acquire+0x20/0x2f0
<4> [259.632786] ? lock_release+0xd0/0x2b0
<4> [259.632791] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.632797] process_one_work+0x239/0x760
<4> [259.632803] worker_thread+0x200/0x3f0
<4> [259.632805] ? __pfx_worker_thread+0x10/0x10
<4> [259.632808] kthread+0x10d/0x150
<4> [259.632811] ? __pfx_kthread+0x10/0x10
<4> [259.632814] ret_from_fork+0x3d4/0x480
<4> [259.632816] ? __pfx_kthread+0x10/0x10
<4> [259.632820] ret_from_fork_asm+0x1a/0x30
<4> [259.632827] </TASK>
<4> [259.632828] irq event stamp: 270887
<4> [259.632829] hardirqs last enabled at (270893): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.632832] hardirqs last disabled at (270898): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.632834] softirqs last enabled at (270138): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.632836] softirqs last disabled at (270127): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.632839] ---[ end trace 0000000000000000 ]---
<6> [259.633797] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.633867] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.633874] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.633926] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [259.634023] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [259.634683] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.634888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.634973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.635060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.635141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.635222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.635301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.635380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.635462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.635550] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.635650] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.635761] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.636767] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.646544] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.646792] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.647976] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.648053] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.648124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.648194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.648264] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.648333] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.648401] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.648468] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.648544] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.648622] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.648691] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.648760] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.648827] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.648894] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.648961] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.649027] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.649094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.649159] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.649223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.649298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.649371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.649443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.649515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.649602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.649686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.649756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.649826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.649898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.649970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.650041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.650111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.650182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.650257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.650332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.650407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.650480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.650561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.650642] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.650712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.650780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.650851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.650921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.650994] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.651065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.651138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.651207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.651277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.651345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.651415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.651482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.651556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.651641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.651711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.651780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.651851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.651922] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.651990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.652060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.652132] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.652241] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.652245] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72707, lrc_seqno=72707, guc_id=0, flags=0x73 in no process [-1]
<7> [259.652248] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.652305] ------------[ cut here ]------------
<4> [259.652306] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.652307] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:218/7009
<4> [259.652374] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.652440] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.652444] CPU: 2 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.652447] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.652448] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.652450] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.652455] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.652520] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.652522] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [259.652524] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.652526] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.652527] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.652528] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.652530] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.652531] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [259.652533] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.652539] CR2: 00007d71ab715098 CR3: 000000000344c002 CR4: 0000000000f72ef0
<4> [259.652542] PKRU: 55555554
<4> [259.652544] Call Trace:
<4> [259.652547] <TASK>
<4> [259.652554] ? lock_acquire+0x20/0x2f0
<4> [259.652563] ? lock_release+0xd0/0x2b0
<4> [259.652573] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.652583] process_one_work+0x239/0x760
<4> [259.652594] worker_thread+0x200/0x3f0
<4> [259.652600] ? __pfx_worker_thread+0x10/0x10
<4> [259.652604] kthread+0x10d/0x150
<4> [259.652608] ? __pfx_kthread+0x10/0x10
<4> [259.652614] ret_from_fork+0x3d4/0x480
<4> [259.652618] ? __pfx_kthread+0x10/0x10
<4> [259.652623] ret_from_fork_asm+0x1a/0x30
<4> [259.652637] </TASK>
<4> [259.652639] irq event stamp: 273983
<4> [259.652641] hardirqs last enabled at (273989): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.652646] hardirqs last disabled at (273994): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.652649] softirqs last enabled at (272880): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.652653] softirqs last disabled at (272871): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.652657] ---[ end trace 0000000000000000 ]---
<5> [259.653562] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72762, lrc_seqno=72762, guc_id=0, flags=0x73 in no process [-1]
<7> [259.653572] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.653920] ------------[ cut here ]------------
<4> [259.653924] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.653926] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:218/7009
<4> [259.654138] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.654242] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.654250] CPU: 3 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.654254] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.654256] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.654259] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.654321] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.654396] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.654398] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [259.654400] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.654402] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.654403] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.654404] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.654405] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.654407] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000
<4> [259.654408] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.654410] CR2: 0000798596afd6f4 CR3: 0000000124092003 CR4: 0000000000f72ef0
<4> [259.654411] PKRU: 55555554
<4> [259.654412] Call Trace:
<4> [259.654413] <TASK>
<4> [259.654417] ? lock_acquire+0x20/0x2f0
<4> [259.654424] ? lock_release+0xd0/0x2b0
<4> [259.654433] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.654443] process_one_work+0x239/0x760
<4> [259.654454] worker_thread+0x200/0x3f0
<4> [259.654458] ? __pfx_worker_thread+0x10/0x10
<4> [259.654461] kthread+0x10d/0x150
<4> [259.654465] ? __pfx_kthread+0x10/0x10
<4> [259.654470] ret_from_fork+0x3d4/0x480
<4> [259.654473] ? __pfx_kthread+0x10/0x10
<4> [259.654477] ret_from_fork_asm+0x1a/0x30
<4> [259.654491] </TASK>
<4> [259.654493] irq event stamp: 276669
<4> [259.654495] hardirqs last enabled at (276675): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.654499] hardirqs last disabled at (276680): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.654502] softirqs last enabled at (272880): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.654506] softirqs last disabled at (272871): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.654509] ---[ end trace 0000000000000000 ]---
<7> [259.654441] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<6> [259.654512] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.654654] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.654665] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.654600] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [259.654756] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.654959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.655043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.655130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.655211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.655294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.655375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.655453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.655542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.655621] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.655712] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.655825] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.656842] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.667543] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.667792] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.668819] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.668895] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.668966] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.669038] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.669109] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.669179] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.669249] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.669320] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.669389] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.669456] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.669525] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.669610] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.669677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.669744] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.669812] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.669880] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.669950] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.670019] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.670088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.670164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.670239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.670313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.670387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.670458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.670529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.670615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.670685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.670758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.670830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.670901] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.670972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.671044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.671120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.671196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.671271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.671343] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.671415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.671484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.671566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.671634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.671704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.671774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.671844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.671912] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.671985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.672052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.672120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.672189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.672263] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.672331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.672401] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.672475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.672554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.672629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.672698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.672769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.672838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.672907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.672980] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.673092] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.673096] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72762, lrc_seqno=72762, guc_id=0, flags=0x73 in no process [-1]
<7> [259.673098] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.673156] ------------[ cut here ]------------
<4> [259.673157] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.673159] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:218/7009
<4> [259.673229] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.673294] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.673298] CPU: 3 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.673301] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.673302] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.673304] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.673309] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.673374] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.673376] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [259.673378] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.673380] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.673381] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.673382] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.673384] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.673385] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000
<4> [259.673386] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.673388] CR2: 0000798596afd6f4 CR3: 0000000124092003 CR4: 0000000000f72ef0
<4> [259.673389] PKRU: 55555554
<4> [259.673391] Call Trace:
<4> [259.673392] <TASK>
<4> [259.673395] ? lock_acquire+0x20/0x2f0
<4> [259.673401] ? lock_release+0xd0/0x2b0
<4> [259.673406] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.673412] process_one_work+0x239/0x760
<4> [259.673418] worker_thread+0x200/0x3f0
<4> [259.673421] ? __pfx_worker_thread+0x10/0x10
<4> [259.673423] kthread+0x10d/0x150
<4> [259.673426] ? __pfx_kthread+0x10/0x10
<4> [259.673430] ret_from_fork+0x3d4/0x480
<4> [259.673432] ? __pfx_kthread+0x10/0x10
<4> [259.673435] ret_from_fork_asm+0x1a/0x30
<4> [259.673443] </TASK>
<4> [259.673444] irq event stamp: 279799
<4> [259.673445] hardirqs last enabled at (279805): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.673448] hardirqs last disabled at (279810): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.673450] softirqs last enabled at (278912): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.673452] softirqs last disabled at (278905): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.673454] ---[ end trace 0000000000000000 ]---
<6> [259.673456] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.673522] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.673527] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.673939] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.674138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.674222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.674307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.674387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.674466] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.674548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.674626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.674705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.674779] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.674871] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.674981] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.675985] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.686704] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.686945] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.687876] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.687950] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.688020] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.688091] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.688162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.688232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.688301] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.688370] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.688438] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.688506] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.688588] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.688659] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.688728] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.688795] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.688862] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.688930] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.688996] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.689064] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.689131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.689205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.689278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.689350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.689422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.689492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.689573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.689645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.689717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.689790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.689863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.689932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.690005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.690076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.690153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.690228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.690304] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.690376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.690447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.690516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.690599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.690666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.690739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.690809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.690878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.690948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.691022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.691093] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.691162] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.691232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.691301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.691370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.691440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.691513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.691594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.691662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.691729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.691797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.691863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.691929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.691999] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.692112] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.692115] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72762, lrc_seqno=72762, guc_id=0, flags=0x73 in no process [-1]
<7> [259.692118] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.692174] ------------[ cut here ]------------
<4> [259.692175] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.692176] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:218/7009
<4> [259.692244] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.692309] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.692313] CPU: 3 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.692316] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.692317] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.692318] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.692323] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.692389] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.692391] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [259.692393] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.692394] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.692396] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.692397] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.692398] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.692399] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000
<4> [259.692401] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.692402] CR2: 0000798596afd6f4 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [259.692404] PKRU: 55555554
<4> [259.692405] Call Trace:
<4> [259.692406] <TASK>
<4> [259.692410] ? lock_acquire+0x20/0x2f0
<4> [259.692415] ? lock_release+0xd0/0x2b0
<4> [259.692421] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.692426] process_one_work+0x239/0x760
<4> [259.692432] worker_thread+0x200/0x3f0
<4> [259.692435] ? __pfx_worker_thread+0x10/0x10
<4> [259.692437] kthread+0x10d/0x150
<4> [259.692440] ? __pfx_kthread+0x10/0x10
<4> [259.692444] ret_from_fork+0x3d4/0x480
<4> [259.692446] ? __pfx_kthread+0x10/0x10
<4> [259.692449] ret_from_fork_asm+0x1a/0x30
<4> [259.692456] </TASK>
<4> [259.692457] irq event stamp: 282891
<4> [259.692459] hardirqs last enabled at (282897): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.692461] hardirqs last disabled at (282902): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.692463] softirqs last enabled at (281908): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.692466] softirqs last disabled at (281901): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.692468] ---[ end trace 0000000000000000 ]---
<7> [259.694430] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [259.694553] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [259.694649] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72817, lrc_seqno=72817, guc_id=0, flags=0x73 in no process [-1]
<7> [259.694651] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.694709] ------------[ cut here ]------------
<4> [259.694710] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.694712] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:218/7009
<4> [259.694782] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.694846] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.694851] CPU: 3 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.694853] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.694854] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.694856] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.694861] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.694926] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.694928] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [259.694930] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.694931] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.694933] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.694934] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.694935] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.694937] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000
<4> [259.694938] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.694939] CR2: 0000798596afd6f4 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [259.694941] PKRU: 55555554
<4> [259.694942] Call Trace:
<4> [259.694943] <TASK>
<4> [259.694947] ? lock_acquire+0x20/0x2f0
<4> [259.694952] ? lock_release+0xd0/0x2b0
<4> [259.694958] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.694963] process_one_work+0x239/0x760
<4> [259.694969] worker_thread+0x200/0x3f0
<4> [259.694972] ? __pfx_worker_thread+0x10/0x10
<4> [259.694974] kthread+0x10d/0x150
<4> [259.694977] ? __pfx_kthread+0x10/0x10
<4> [259.694981] ret_from_fork+0x3d4/0x480
<4> [259.694983] ? __pfx_kthread+0x10/0x10
<4> [259.694986] ret_from_fork_asm+0x1a/0x30
<4> [259.694993] </TASK>
<4> [259.694995] irq event stamp: 285725
<4> [259.694996] hardirqs last enabled at (285731): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.694998] hardirqs last disabled at (285736): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.695001] softirqs last enabled at (281908): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.695003] softirqs last disabled at (281901): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.695005] ---[ end trace 0000000000000000 ]---
<6> [259.695007] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.695072] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.695079] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.695178] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.695378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.695462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.695556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.695639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.695719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.695796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.695876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.695955] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.696030] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.696120] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.696233] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.697243] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.707540] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.707821] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.708833] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.708902] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.708967] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.709032] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.709097] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.709161] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.709224] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.709287] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.709351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.709412] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.709474] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.709542] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.709609] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.709673] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.709735] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.709796] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.709857] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.709918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.709981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.710051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.710120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.710187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.710253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.710318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.710386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.710451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.710515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.710595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.710667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.710732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.710797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.710861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.710931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.710999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.711068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.711134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.711201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.711267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.711332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.711394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.711459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.711523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.711607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.711674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.711740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.711802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.711863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.711923] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.711984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.712043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.712101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.712163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.712224] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.712284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.712344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.712404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.712462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.712520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.712600] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.712708] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.712712] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72817, lrc_seqno=72817, guc_id=0, flags=0x73 in no process [-1]
<7> [259.712714] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.712770] ------------[ cut here ]------------
<4> [259.712771] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.712772] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:218/7009
<4> [259.712835] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.712894] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.712898] CPU: 3 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.712900] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.712901] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.712903] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.712907] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.712967] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.712969] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [259.712971] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.712972] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.712973] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.712974] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.712975] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.712977] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000
<4> [259.712978] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.712979] CR2: 0000798596afd6f4 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [259.712981] PKRU: 55555554
<4> [259.712982] Call Trace:
<4> [259.712983] <TASK>
<4> [259.712986] ? lock_acquire+0x20/0x2f0
<4> [259.712991] ? lock_release+0xd0/0x2b0
<4> [259.712996] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.713001] process_one_work+0x239/0x760
<4> [259.713007] worker_thread+0x200/0x3f0
<4> [259.713009] ? __pfx_worker_thread+0x10/0x10
<4> [259.713012] kthread+0x10d/0x150
<4> [259.713014] ? __pfx_kthread+0x10/0x10
<4> [259.713018] ret_from_fork+0x3d4/0x480
<4> [259.713019] ? __pfx_kthread+0x10/0x10
<4> [259.713022] ret_from_fork_asm+0x1a/0x30
<4> [259.713029] </TASK>
<4> [259.713030] irq event stamp: 288835
<4> [259.713031] hardirqs last enabled at (288841): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.713034] hardirqs last disabled at (288846): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.713036] softirqs last enabled at (287986): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.713038] softirqs last disabled at (287979): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.713040] ---[ end trace 0000000000000000 ]---
<6> [259.713041] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.713101] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.713107] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.713288] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.713479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.713559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.713634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.713706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.713776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.713846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.713915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.713984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.714052] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.714134] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.714237] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.715229] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.725884] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.726125] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.727289] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.727358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.727422] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.727487] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.727561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.727624] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.727688] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.727749] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.727811] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.727873] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.727937] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.728002] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.728065] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.728126] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.728189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.728250] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.728309] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.728370] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.728430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.728499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.728578] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.728650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.728716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.728779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.728842] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.728906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.728969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.729034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.729101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.729167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.729231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.729297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.729367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.729437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.729507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.729589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.729661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.729732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.729803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.729873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.729943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.730014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.730085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.730153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.730226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.730295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.730365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.730434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.730505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.730589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.730661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.730735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.730803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.730872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.730941] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.731008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.731075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.731143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.731215] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.731326] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.731329] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72817, lrc_seqno=72817, guc_id=0, flags=0x73 in no process [-1]
<7> [259.731332] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.731388] ------------[ cut here ]------------
<4> [259.731389] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.731390] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#3: kworker/u64:218/7009
<4> [259.731458] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.731521] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.731530] CPU: 3 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.731534] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.731535] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.731536] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.731542] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.731607] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.731609] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [259.731611] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.731612] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.731613] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.731615] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.731616] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.731617] FS: 0000000000000000(0000) GS:ffff8888dae17000(0000) knlGS:0000000000000000
<4> [259.731619] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.731620] CR2: 0000798596afd6f4 CR3: 000000000344c004 CR4: 0000000000f72ef0
<4> [259.731622] PKRU: 55555554
<4> [259.731623] Call Trace:
<4> [259.731624] <TASK>
<4> [259.731628] ? lock_acquire+0x20/0x2f0
<4> [259.731633] ? lock_release+0xd0/0x2b0
<4> [259.731638] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.731644] process_one_work+0x239/0x760
<4> [259.731650] worker_thread+0x200/0x3f0
<4> [259.731653] ? __pfx_worker_thread+0x10/0x10
<4> [259.731655] kthread+0x10d/0x150
<4> [259.731658] ? __pfx_kthread+0x10/0x10
<4> [259.731662] ret_from_fork+0x3d4/0x480
<4> [259.731664] ? __pfx_kthread+0x10/0x10
<4> [259.731667] ret_from_fork_asm+0x1a/0x30
<4> [259.731674] </TASK>
<4> [259.731675] irq event stamp: 291933
<4> [259.731676] hardirqs last enabled at (291939): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.731679] hardirqs last disabled at (291944): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.731681] softirqs last enabled at (291024): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.731684] softirqs last disabled at (291017): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.731686] ---[ end trace 0000000000000000 ]---
<7> [259.732721] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [259.732862] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [259.733537] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72872, lrc_seqno=72872, guc_id=0, flags=0x73 in no process [-1]
<7> [259.733542] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.733630] ------------[ cut here ]------------
<4> [259.733631] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.733633] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:218/7009
<4> [259.733716] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.733784] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.733789] CPU: 2 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.733792] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.733793] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.733795] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.733800] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.733867] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.733869] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [259.733871] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.733872] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.733874] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.733875] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.733876] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.733877] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [259.733879] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.733880] CR2: 00007d71ab715098 CR3: 000000000344c002 CR4: 0000000000f72ef0
<4> [259.733882] PKRU: 55555554
<4> [259.733883] Call Trace:
<4> [259.733884] <TASK>
<4> [259.733888] ? lock_acquire+0x20/0x2f0
<4> [259.733894] ? lock_release+0xd0/0x2b0
<4> [259.733899] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.733904] process_one_work+0x239/0x760
<4> [259.733911] worker_thread+0x200/0x3f0
<4> [259.733913] ? __pfx_worker_thread+0x10/0x10
<4> [259.733916] kthread+0x10d/0x150
<4> [259.733919] ? __pfx_kthread+0x10/0x10
<4> [259.733922] ret_from_fork+0x3d4/0x480
<4> [259.733924] ? __pfx_kthread+0x10/0x10
<4> [259.733928] ret_from_fork_asm+0x1a/0x30
<4> [259.733935] </TASK>
<4> [259.733936] irq event stamp: 294435
<4> [259.733937] hardirqs last enabled at (294441): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.733940] hardirqs last disabled at (294446): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.733942] softirqs last enabled at (291024): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.733944] softirqs last disabled at (291017): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.733947] ---[ end trace 0000000000000000 ]---
<6> [259.733949] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.734015] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.734021] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.734215] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.734414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.734499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.734605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.734711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.734792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.734872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.734950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.735029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.735102] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.735191] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.735301] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.736310] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.746886] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.747133] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.748094] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.748171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.748242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.748314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.748387] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.748461] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.748540] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.748619] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.748687] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.748756] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.748826] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.748894] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.748961] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.749028] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.749095] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.749161] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.749228] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.749294] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.749362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.749438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.749512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.749599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.749686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.749756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.749828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.749898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.749967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.750040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.750110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.750180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.750255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.750328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.750406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.750484] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.750573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.750656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.750728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.750797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.750868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.750934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.751005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.751077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.751147] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.751216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.751288] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.751354] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.751422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.751490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.751572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.751652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.751721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.751793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.751863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.751934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.752003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.752074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.752144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.752213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.752285] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.752395] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.752399] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72872, lrc_seqno=72872, guc_id=0, flags=0x73 in no process [-1]
<7> [259.752402] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.752461] ------------[ cut here ]------------
<4> [259.752463] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.752464] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:218/7009
<4> [259.752541] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.752628] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.752632] CPU: 2 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.752635] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.752636] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.752638] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.752643] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.752709] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.752711] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [259.752713] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.752714] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.752716] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.752717] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.752718] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.752719] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [259.752721] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.752722] CR2: 00007d71ab715098 CR3: 000000000344c002 CR4: 0000000000f72ef0
<4> [259.752724] PKRU: 55555554
<4> [259.752725] Call Trace:
<4> [259.752726] <TASK>
<4> [259.752730] ? lock_acquire+0x20/0x2f0
<4> [259.752736] ? lock_release+0xd0/0x2b0
<4> [259.752741] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.752747] process_one_work+0x239/0x760
<4> [259.752753] worker_thread+0x200/0x3f0
<4> [259.752755] ? __pfx_worker_thread+0x10/0x10
<4> [259.752758] kthread+0x10d/0x150
<4> [259.752761] ? __pfx_kthread+0x10/0x10
<4> [259.752764] ret_from_fork+0x3d4/0x480
<4> [259.752766] ? __pfx_kthread+0x10/0x10
<4> [259.752770] ret_from_fork_asm+0x1a/0x30
<4> [259.752777] </TASK>
<4> [259.752778] irq event stamp: 297517
<4> [259.752779] hardirqs last enabled at (297523): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.752782] hardirqs last disabled at (297528): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.752784] softirqs last enabled at (296282): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.752787] softirqs last disabled at (296273): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.752789] ---[ end trace 0000000000000000 ]---
<6> [259.752791] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.752857] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.752863] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.754098] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [259.754201] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [259.754300] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.754509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.754612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.754704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.754785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.754865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.754943] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.755023] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.755103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.755179] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.755269] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.755381] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.756386] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.766531] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.766774] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.767776] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.767850] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.767921] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.767993] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.768063] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.768132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.768202] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.768270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.768338] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.768406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.768474] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.768547] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.768618] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.768686] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.768755] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.768824] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.768891] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.768960] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.769027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.769102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.769176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.769248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.769321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.769391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.769461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.769534] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.769605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.769676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.769749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.769821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.769892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.769964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.770041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.770120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.770196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.770268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.770339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.770408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.770477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.770552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.770629] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.770701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.770771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.770838] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.770909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.770978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.771046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.771113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.771182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.771250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.771316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.771385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.771452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.771528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.771596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.771667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.771734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.771803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.771876] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.771986] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.771990] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72872, lrc_seqno=72872, guc_id=0, flags=0x73 in no process [-1]
<7> [259.771992] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.772050] ------------[ cut here ]------------
<4> [259.772051] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.772053] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:221/7012
<4> [259.772120] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.772186] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.772191] CPU: 6 UID: 0 PID: 7012 Comm: kworker/u64:221 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.772194] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.772195] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.772196] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.772202] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.772273] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.772274] RSP: 0018:ffffc9000752fca0 EFLAGS: 00010246
<4> [259.772277] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.772278] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.772279] RBP: ffffc9000752fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.772281] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.772282] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.772283] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [259.772285] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.772286] CR2: 0000614ba7466ac8 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [259.772288] PKRU: 55555554
<4> [259.772289] Call Trace:
<4> [259.772290] <TASK>
<4> [259.772294] ? lock_acquire+0x20/0x2f0
<4> [259.772300] ? lock_release+0xd0/0x2b0
<4> [259.772305] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.772311] process_one_work+0x239/0x760
<4> [259.772317] worker_thread+0x200/0x3f0
<4> [259.772320] ? __pfx_worker_thread+0x10/0x10
<4> [259.772322] kthread+0x10d/0x150
<4> [259.772325] ? __pfx_kthread+0x10/0x10
<4> [259.772329] ret_from_fork+0x3d4/0x480
<4> [259.772331] ? __pfx_kthread+0x10/0x10
<4> [259.772334] ret_from_fork_asm+0x1a/0x30
<4> [259.772342] </TASK>
<4> [259.772343] irq event stamp: 218379
<4> [259.772344] hardirqs last enabled at (218385): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.772347] hardirqs last disabled at (218390): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.772349] softirqs last enabled at (217402): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.772351] softirqs last disabled at (217395): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.772354] ---[ end trace 0000000000000000 ]---
<5> [259.773465] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72927, lrc_seqno=72927, guc_id=0, flags=0x73 in no process [-1]
<7> [259.773475] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.773687] ------------[ cut here ]------------
<4> [259.773691] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.773693] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#12: kworker/u64:221/7012
<4> [259.773821] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi
<7> [259.773814] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<4> [259.773864] mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.773933] CPU: 12 UID: 0 PID: 7012 Comm: kworker/u64:221 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.773938] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.773939] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.773942] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<7> [259.773915] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<4> [259.773950] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.774069] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.774072] RSP: 0018:ffffc9000752fca0 EFLAGS: 00010246
<4> [259.774075] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.774078] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.774080] RBP: ffffc9000752fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.774082] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.774083] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.774086] FS: 0000000000000000(0000) GS:ffff8888db297000(0000) knlGS:0000000000000000
<4> [259.774088] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.774090] CR2: 0000614ba7466ac8 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [259.774092] PKRU: 55555554
<4> [259.774094] Call Trace:
<4> [259.774096] <TASK>
<4> [259.774102] ? lock_acquire+0x20/0x2f0
<4> [259.774111] ? lock_release+0xd0/0x2b0
<4> [259.774120] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.774129] process_one_work+0x239/0x760
<4> [259.774140] worker_thread+0x200/0x3f0
<4> [259.774144] ? __pfx_worker_thread+0x10/0x10
<4> [259.774147] kthread+0x10d/0x150
<4> [259.774151] ? __pfx_kthread+0x10/0x10
<4> [259.774157] ret_from_fork+0x3d4/0x480
<4> [259.774159] ? __pfx_kthread+0x10/0x10
<4> [259.774164] ret_from_fork_asm+0x1a/0x30
<4> [259.774177] </TASK>
<4> [259.774178] irq event stamp: 221127
<4> [259.774180] hardirqs last enabled at (221133): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.774184] hardirqs last disabled at (221138): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.774187] softirqs last enabled at (220356): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.774190] softirqs last disabled at (220309): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.774193] ---[ end trace 0000000000000000 ]---
<6> [259.774196] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.774311] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.774321] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.774446] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.774716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.774796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.774881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.774960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.775038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.775119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.775198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.775275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.775350] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.775440] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.775556] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.776558] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.786529] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.786777] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.787800] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.787876] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.787947] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.788018] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.788086] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.788155] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.788223] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.788291] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.788361] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.788429] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.788499] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.788577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.788646] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.788716] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.788784] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.788855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.788922] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.788988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.789053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.789129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.789205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.789276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.789349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.789419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.789489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.789567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.789639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.789716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.789788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.789860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.789931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.790003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.790081] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.790158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.790234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.790306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.790378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.790446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.790514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.790597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.790669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.790740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.790808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.790875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.790946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.791015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.791083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.791151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.791221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.791290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.791362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.791433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.791504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.791582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.791650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.791719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.791786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.791854] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.791925] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.792033] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.792037] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72927, lrc_seqno=72927, guc_id=0, flags=0x73 in no process [-1]
<7> [259.792040] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.792097] ------------[ cut here ]------------
<4> [259.792098] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.792099] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:221/7012
<4> [259.792168] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.792232] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.792237] CPU: 6 UID: 0 PID: 7012 Comm: kworker/u64:221 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.792239] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.792241] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.792242] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.792247] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.792315] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.792316] RSP: 0018:ffffc9000752fca0 EFLAGS: 00010246
<4> [259.792319] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.792320] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.792321] RBP: ffffc9000752fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.792322] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.792324] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.792325] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [259.792327] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.792328] CR2: 0000614ba7466ac8 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [259.792329] PKRU: 55555554
<4> [259.792330] Call Trace:
<4> [259.792332] <TASK>
<4> [259.792335] ? lock_acquire+0x20/0x2f0
<4> [259.792341] ? lock_release+0xd0/0x2b0
<4> [259.792346] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.792351] process_one_work+0x239/0x760
<4> [259.792357] worker_thread+0x200/0x3f0
<4> [259.792360] ? __pfx_worker_thread+0x10/0x10
<4> [259.792363] kthread+0x10d/0x150
<4> [259.792365] ? __pfx_kthread+0x10/0x10
<4> [259.792369] ret_from_fork+0x3d4/0x480
<4> [259.792371] ? __pfx_kthread+0x10/0x10
<4> [259.792374] ret_from_fork_asm+0x1a/0x30
<4> [259.792382] </TASK>
<4> [259.792383] irq event stamp: 224237
<4> [259.792384] hardirqs last enabled at (224243): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.792387] hardirqs last disabled at (224248): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.792389] softirqs last enabled at (223260): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.792391] softirqs last disabled at (223255): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.792393] ---[ end trace 0000000000000000 ]---
<6> [259.792395] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.792462] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.792468] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.793701] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [259.793801] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [259.793902] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.794108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.794196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.794283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.794364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.794444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.794537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.794627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.794710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.794789] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.794877] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.794987] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.795992] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.806526] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.806769] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.807798] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.807881] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.807959] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.808032] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.808102] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.808171] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.808240] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.808308] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.808375] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.808443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.808511] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.808594] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.808663] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.808729] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.808796] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.808861] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.808928] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.808992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.809058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.809133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.809208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.809280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.809352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.809422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.809490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.809566] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.809638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.809710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.809780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.809849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.809920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.809989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.810064] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.810138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.810213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.810284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.810357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.810427] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.810497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.810574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.810649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.810718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.810788] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.810855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.810927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.810995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.811062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.811129] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.811198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.811266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.811330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.811398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.811465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.811539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.811604] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.811672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.811737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.811802] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.811873] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.812283] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.812289] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72927, lrc_seqno=72927, guc_id=0, flags=0x73 in no process [-1]
<7> [259.812291] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.812350] ------------[ cut here ]------------
<4> [259.812351] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.812352] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:218/7009
<4> [259.812422] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.812488] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.812492] CPU: 8 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.812495] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.812497] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.812498] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.812503] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.812585] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.812587] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [259.812589] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.812591] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.812592] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.812594] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.812595] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.812596] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [259.812598] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.812599] CR2: 000072daae116910 CR3: 0000000124092006 CR4: 0000000000f72ef0
<4> [259.812601] PKRU: 55555554
<4> [259.812602] Call Trace:
<4> [259.812603] <TASK>
<4> [259.812607] ? lock_acquire+0x20/0x2f0
<4> [259.812613] ? lock_release+0xd0/0x2b0
<4> [259.812618] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.812624] process_one_work+0x239/0x760
<4> [259.812630] worker_thread+0x200/0x3f0
<4> [259.812633] ? __pfx_worker_thread+0x10/0x10
<4> [259.812635] kthread+0x10d/0x150
<4> [259.812639] ? __pfx_kthread+0x10/0x10
<4> [259.812642] ret_from_fork+0x3d4/0x480
<4> [259.812645] ? __pfx_kthread+0x10/0x10
<4> [259.812648] ret_from_fork_asm+0x1a/0x30
<4> [259.812655] </TASK>
<4> [259.812657] irq event stamp: 300947
<4> [259.812658] hardirqs last enabled at (300953): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.812661] hardirqs last disabled at (300958): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.812663] softirqs last enabled at (300786): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.812666] softirqs last disabled at (300781): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.812668] ---[ end trace 0000000000000000 ]---
<5> [259.813262] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72982, lrc_seqno=72982, guc_id=0, flags=0x73 in no process [-1]
<7> [259.813266] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.813359] ------------[ cut here ]------------
<4> [259.813361] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.813364] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:220/7011
<4> [259.813437] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.813511] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.813516] CPU: 2 UID: 0 PID: 7011 Comm: kworker/u64:220 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.813530] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.813533] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.813536] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.813546] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.813651] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.813653] RSP: 0018:ffffc90007527ca0 EFLAGS: 00010246
<4> [259.813658] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.813659] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.813661] RBP: ffffc90007527db0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.813662] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.813663] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.813664] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [259.813666] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.813667] CR2: 00007d71ab715098 CR3: 000000000344c002 CR4: 0000000000f72ef0
<4> [259.813669] PKRU: 55555554
<4> [259.813670] Call Trace:
<4> [259.813671] <TASK>
<4> [259.813676] ? lock_acquire+0x20/0x2f0
<4> [259.813682] ? lock_release+0xd0/0x2b0
<4> [259.813687] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.813694] process_one_work+0x239/0x760
<4> [259.813700] worker_thread+0x200/0x3f0
<4> [259.813703] ? __pfx_worker_thread+0x10/0x10
<4> [259.813705] kthread+0x10d/0x150
<4> [259.813708] ? __pfx_kthread+0x10/0x10
<4> [259.813712] ret_from_fork+0x3d4/0x480
<4> [259.813714] ? __pfx_kthread+0x10/0x10
<4> [259.813717] ret_from_fork_asm+0x1a/0x30
<4> [259.813725] </TASK>
<4> [259.813726] irq event stamp: 444311
<4> [259.813727] hardirqs last enabled at (444317): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.813730] hardirqs last disabled at (444322): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.813732] softirqs last enabled at (444120): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.813735] softirqs last disabled at (444115): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.813738] ---[ end trace 0000000000000000 ]---
<6> [259.813741] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.813813] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.814177] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.814231] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [259.814332] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [259.814434] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.814634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.814720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.814805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.814889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.814970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.815047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.815125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.815204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.815278] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.815368] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.815481] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.816494] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.826525] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.826774] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.827792] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.827867] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.827939] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.828012] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.828081] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.828151] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.828219] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.828288] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.828358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.828426] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.828495] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.828577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.828646] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.828713] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.828780] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.828846] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.828913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.828979] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.829047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.829122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.829198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.829268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.829342] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.829410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.829479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.829559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.829630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.829706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.829778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.829849] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.829921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.829992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.830070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.830146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.830222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.830296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.830368] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.830439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.830509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.830594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.830670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.830742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.830812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.830880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.830953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.831021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.831090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.831156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.831225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.831297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.831365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.831438] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.831508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.831592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.831661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.831729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.831799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.831865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.831935] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.832043] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.832048] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72982, lrc_seqno=72982, guc_id=0, flags=0x73 in no process [-1]
<7> [259.832050] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.832107] ------------[ cut here ]------------
<4> [259.832108] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.832109] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:218/7009
<4> [259.832179] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.832243] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.832248] CPU: 8 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.832251] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.832252] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.832253] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.832259] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.832324] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.832326] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [259.832328] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.832329] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.832331] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.832332] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.832333] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.832334] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [259.832336] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.832337] CR2: 000072daae116910 CR3: 0000000124092006 CR4: 0000000000f72ef0
<4> [259.832339] PKRU: 55555554
<4> [259.832340] Call Trace:
<4> [259.832341] <TASK>
<4> [259.832345] ? lock_acquire+0x20/0x2f0
<4> [259.832351] ? lock_release+0xd0/0x2b0
<4> [259.832356] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.832361] process_one_work+0x239/0x760
<4> [259.832367] worker_thread+0x200/0x3f0
<4> [259.832370] ? __pfx_worker_thread+0x10/0x10
<4> [259.832373] kthread+0x10d/0x150
<4> [259.832375] ? __pfx_kthread+0x10/0x10
<4> [259.832379] ret_from_fork+0x3d4/0x480
<4> [259.832381] ? __pfx_kthread+0x10/0x10
<4> [259.832384] ret_from_fork_asm+0x1a/0x30
<4> [259.832392] </TASK>
<4> [259.832393] irq event stamp: 306433
<4> [259.832394] hardirqs last enabled at (306439): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.832397] hardirqs last disabled at (306444): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.832399] softirqs last enabled at (305456): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.832401] softirqs last disabled at (305447): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.832403] ---[ end trace 0000000000000000 ]---
<6> [259.832405] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.832471] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.832476] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.833783] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [259.833885] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [259.833983] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.834183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.834292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.834409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.834524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.834635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.834741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.834851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.834960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.835064] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.835155] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.835268] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.836275] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.846524] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.846768] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.847764] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.847839] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.847910] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.847981] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.848051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.848121] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.848191] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.848262] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.848331] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.848400] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.848467] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.848542] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.848609] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.848676] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.848743] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.848812] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.848878] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.848946] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.849014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.849091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.849168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.849241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.849313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.849383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.849453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.849524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.849591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.849660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.849732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.849801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.849873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.849942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.850018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.850095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.850168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.850239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.850308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.850376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.850446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.850517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.850592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.850662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.850731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.850801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.850875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.850945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.851015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.851085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.851156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.851225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.851296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.851369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.851441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.851509] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.851596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.851667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.851736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.851805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.851878] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.851986] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.851990] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=72982, lrc_seqno=72982, guc_id=0, flags=0x73 in no process [-1]
<7> [259.851992] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.852049] ------------[ cut here ]------------
<4> [259.852050] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.852051] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:218/7009
<4> [259.852118] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.852182] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.852187] CPU: 8 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.852189] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.852190] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.852192] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.852197] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.852262] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.852264] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [259.852266] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.852268] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.852269] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.852270] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.852271] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.852273] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [259.852274] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.852276] CR2: 000072daae116910 CR3: 0000000124092006 CR4: 0000000000f72ef0
<4> [259.852277] PKRU: 55555554
<4> [259.852278] Call Trace:
<4> [259.852279] <TASK>
<4> [259.852283] ? lock_acquire+0x20/0x2f0
<4> [259.852289] ? lock_release+0xd0/0x2b0
<4> [259.852294] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.852300] process_one_work+0x239/0x760
<4> [259.852306] worker_thread+0x200/0x3f0
<4> [259.852308] ? __pfx_worker_thread+0x10/0x10
<4> [259.852311] kthread+0x10d/0x150
<4> [259.852314] ? __pfx_kthread+0x10/0x10
<4> [259.852317] ret_from_fork+0x3d4/0x480
<4> [259.852319] ? __pfx_kthread+0x10/0x10
<4> [259.852323] ret_from_fork_asm+0x1a/0x30
<4> [259.852330] </TASK>
<4> [259.852331] irq event stamp: 309571
<4> [259.852332] hardirqs last enabled at (309577): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.852335] hardirqs last disabled at (309582): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.852337] softirqs last enabled at (308698): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.852339] softirqs last disabled at (308677): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.852342] ---[ end trace 0000000000000000 ]---
<5> [259.853736] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73037, lrc_seqno=73037, guc_id=0, flags=0x73 in no process [-1]
<7> [259.853740] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.853801] ------------[ cut here ]------------
<4> [259.853802] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.853803] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:218/7009
<4> [259.853872] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.853936] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.853940] CPU: 8 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.853942] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.853943] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.853945] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.853950] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.854014] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.854015] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [259.854018] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.854019] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.854020] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.854021] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.854022] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.854024] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [259.854025] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.854026] CR2: 000072daae116910 CR3: 0000000124092006 CR4: 0000000000f72ef0
<4> [259.854028] PKRU: 55555554
<4> [259.854029] Call Trace:
<4> [259.854030] <TASK>
<4> [259.854034] ? lock_acquire+0x20/0x2f0
<4> [259.854039] ? lock_release+0xd0/0x2b0
<4> [259.854044] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.854050] process_one_work+0x239/0x760
<4> [259.854056] worker_thread+0x200/0x3f0
<4> [259.854058] ? __pfx_worker_thread+0x10/0x10
<4> [259.854061] kthread+0x10d/0x150
<4> [259.854063] ? __pfx_kthread+0x10/0x10
<4> [259.854067] ret_from_fork+0x3d4/0x480
<4> [259.854069] ? __pfx_kthread+0x10/0x10
<4> [259.854072] ret_from_fork_asm+0x1a/0x30
<4> [259.854079] </TASK>
<4> [259.854080] irq event stamp: 312313
<4> [259.854082] hardirqs last enabled at (312319): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.854084] hardirqs last disabled at (312324): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.854086] softirqs last enabled at (309960): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.854089] softirqs last disabled at (309955): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.854091] ---[ end trace 0000000000000000 ]---
<6> [259.854092] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.854157] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.854163] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.854399] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [259.854499] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [259.854610] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.854811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.854895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.854988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.855068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.855148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.855227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.855307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.855387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.855464] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.855565] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.855677] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.856679] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.866520] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.866768] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.867743] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.867819] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.867890] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.867962] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.868033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.868103] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.868173] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.868242] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.868310] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.868379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.868447] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.868519] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.868587] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.868655] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.868720] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.868788] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.868857] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.868925] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.868992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.869067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.869143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.869218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.869292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.869362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.869434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.869505] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.869592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.869664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.869736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.869808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.869880] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.869952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.870028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.870106] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.870185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.870257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.870329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.870398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.870468] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.870546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.870619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.870691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.870761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.870828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.870899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.870969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.871037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.871105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.871173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.871241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.871309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.871378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.871446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.871520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.871587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.871656] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.871723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.871790] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.871861] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.871969] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.871973] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73037, lrc_seqno=73037, guc_id=0, flags=0x73 in no process [-1]
<7> [259.871976] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.872034] ------------[ cut here ]------------
<4> [259.872035] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.872036] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:218/7009
<4> [259.872104] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.872168] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.872172] CPU: 8 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.872175] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.872176] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.872178] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.872183] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.872249] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.872250] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [259.872253] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.872254] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.872255] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.872256] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.872258] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.872259] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [259.872260] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.872262] CR2: 000072daae116910 CR3: 0000000124092006 CR4: 0000000000f72ef0
<4> [259.872263] PKRU: 55555554
<4> [259.872264] Call Trace:
<4> [259.872266] <TASK>
<4> [259.872270] ? lock_acquire+0x20/0x2f0
<4> [259.872275] ? lock_release+0xd0/0x2b0
<4> [259.872280] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.872286] process_one_work+0x239/0x760
<4> [259.872292] worker_thread+0x200/0x3f0
<4> [259.872295] ? __pfx_worker_thread+0x10/0x10
<4> [259.872297] kthread+0x10d/0x150
<4> [259.872300] ? __pfx_kthread+0x10/0x10
<4> [259.872304] ret_from_fork+0x3d4/0x480
<4> [259.872306] ? __pfx_kthread+0x10/0x10
<4> [259.872309] ret_from_fork_asm+0x1a/0x30
<4> [259.872317] </TASK>
<4> [259.872318] irq event stamp: 315461
<4> [259.872319] hardirqs last enabled at (315467): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.872321] hardirqs last disabled at (315472): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.872324] softirqs last enabled at (314582): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.872326] softirqs last disabled at (314561): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.872328] ---[ end trace 0000000000000000 ]---
<6> [259.872330] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.872395] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.872401] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.873428] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [259.873539] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [259.873642] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.873851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.873942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.874033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.874115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.874193] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.874269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.874345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.874423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.874497] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.874601] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.874712] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.875716] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.885519] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.885764] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.886776] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.886851] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.886922] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.886993] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.887063] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.887133] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.887201] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.887269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.887337] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.887406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.887473] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.887549] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.887616] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.887683] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.887751] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.887819] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.887886] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.887952] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.888019] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.888096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.888170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.888243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.888317] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.888387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.888458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.888539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.888609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.888682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.888756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.888828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.888900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.888972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.889049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.889128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.889205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.889279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.889352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.889430] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.889502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.889587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.889660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.889729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.889798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.889866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.889939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.890006] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.890074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.890142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.890212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.890279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.890345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.890414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.890482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.890565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.890633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.890702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.890768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.890835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.890906] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.891016] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.891020] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73037, lrc_seqno=73037, guc_id=0, flags=0x73 in no process [-1]
<7> [259.891023] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.891080] ------------[ cut here ]------------
<4> [259.891081] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.891082] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:221/7012
<4> [259.891150] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.891215] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.891220] CPU: 10 UID: 0 PID: 7012 Comm: kworker/u64:221 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.891223] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.891224] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.891226] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.891231] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.891296] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.891298] RSP: 0018:ffffc9000752fca0 EFLAGS: 00010246
<4> [259.891300] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.891302] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.891303] RBP: ffffc9000752fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.891304] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.891306] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.891307] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [259.891309] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.891310] CR2: 00007d71ab80509c CR3: 0000000124092005 CR4: 0000000000f72ef0
<4> [259.891312] PKRU: 55555554
<4> [259.891313] Call Trace:
<4> [259.891314] <TASK>
<4> [259.891318] ? lock_acquire+0x20/0x2f0
<4> [259.891323] ? lock_release+0xd0/0x2b0
<4> [259.891329] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.891334] process_one_work+0x239/0x760
<4> [259.891341] worker_thread+0x200/0x3f0
<4> [259.891344] ? __pfx_worker_thread+0x10/0x10
<4> [259.891346] kthread+0x10d/0x150
<4> [259.891349] ? __pfx_kthread+0x10/0x10
<4> [259.891353] ret_from_fork+0x3d4/0x480
<4> [259.891355] ? __pfx_kthread+0x10/0x10
<4> [259.891358] ret_from_fork_asm+0x1a/0x30
<4> [259.891365] </TASK>
<4> [259.891366] irq event stamp: 228105
<4> [259.891367] hardirqs last enabled at (228111): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.891370] hardirqs last disabled at (228116): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.891373] softirqs last enabled at (227226): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.891375] softirqs last disabled at (227185): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.891377] ---[ end trace 0000000000000000 ]---
<5> [259.892755] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73092, lrc_seqno=73092, guc_id=0, flags=0x73 in no process [-1]
<7> [259.892758] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.892819] ------------[ cut here ]------------
<4> [259.892820] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.892822] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:221/7012
<4> [259.892890] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.892954] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.892958] CPU: 10 UID: 0 PID: 7012 Comm: kworker/u64:221 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.892961] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.892962] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.892964] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.892968] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.893032] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.893034] RSP: 0018:ffffc9000752fca0 EFLAGS: 00010246
<4> [259.893036] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.893037] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.893039] RBP: ffffc9000752fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.893040] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.893041] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.893042] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [259.893044] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.893045] CR2: 00007d71ab80509c CR3: 0000000124092005 CR4: 0000000000f72ef0
<4> [259.893046] PKRU: 55555554
<4> [259.893048] Call Trace:
<4> [259.893049] <TASK>
<4> [259.893052] ? lock_acquire+0x20/0x2f0
<4> [259.893057] ? lock_release+0xd0/0x2b0
<4> [259.893063] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.893068] process_one_work+0x239/0x760
<4> [259.893074] worker_thread+0x200/0x3f0
<4> [259.893077] ? __pfx_worker_thread+0x10/0x10
<4> [259.893079] kthread+0x10d/0x150
<4> [259.893082] ? __pfx_kthread+0x10/0x10
<4> [259.893085] ret_from_fork+0x3d4/0x480
<4> [259.893087] ? __pfx_kthread+0x10/0x10
<4> [259.893090] ret_from_fork_asm+0x1a/0x30
<4> [259.893097] </TASK>
<4> [259.893098] irq event stamp: 230703
<4> [259.893100] hardirqs last enabled at (230709): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.893102] hardirqs last disabled at (230714): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.893104] softirqs last enabled at (227226): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.893107] softirqs last disabled at (227185): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.893109] ---[ end trace 0000000000000000 ]---
<6> [259.893111] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.893175] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.893181] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.893399] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [259.893498] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [259.893610] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.893813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.893897] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.893982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.894062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.894142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.894222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.894301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.894382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.894457] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.894554] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.894666] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.895671] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.905516] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.905762] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.906781] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.906856] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.906927] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.906999] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.907068] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.907137] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.907205] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.907273] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.907339] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.907407] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.907477] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.907556] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.907624] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.907693] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.907765] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.907834] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.907902] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.907970] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.908037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.908112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.908188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.908260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.908334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.908405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.908475] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.908555] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.908627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.908700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.908772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.908843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.908913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.908982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.909056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.909132] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.909206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.909278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.909350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.909419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.909490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.909568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.909641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.909710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.909779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.909848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.909920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.909990] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.910060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.910128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.910198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.910266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.910335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.910407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.910476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.910554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.910623] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.910694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.910761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.910828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.910900] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.911009] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.911012] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73092, lrc_seqno=73092, guc_id=0, flags=0x73 in no process [-1]
<7> [259.911015] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.911071] ------------[ cut here ]------------
<4> [259.911073] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.911074] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:221/7012
<4> [259.911141] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.911205] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.911209] CPU: 10 UID: 0 PID: 7012 Comm: kworker/u64:221 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.911212] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.911213] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.911215] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.911220] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.911287] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.911288] RSP: 0018:ffffc9000752fca0 EFLAGS: 00010246
<4> [259.911290] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.911292] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.911293] RBP: ffffc9000752fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.911294] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.911295] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.911297] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [259.911298] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.911300] CR2: 00007d71ab80509c CR3: 0000000122329006 CR4: 0000000000f72ef0
<4> [259.911301] PKRU: 55555554
<4> [259.911302] Call Trace:
<4> [259.911303] <TASK>
<4> [259.911307] ? lock_acquire+0x20/0x2f0
<4> [259.911313] ? lock_release+0xd0/0x2b0
<4> [259.911318] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.911323] process_one_work+0x239/0x760
<4> [259.911329] worker_thread+0x200/0x3f0
<4> [259.911332] ? __pfx_worker_thread+0x10/0x10
<4> [259.911334] kthread+0x10d/0x150
<4> [259.911337] ? __pfx_kthread+0x10/0x10
<4> [259.911341] ret_from_fork+0x3d4/0x480
<4> [259.911343] ? __pfx_kthread+0x10/0x10
<4> [259.911346] ret_from_fork_asm+0x1a/0x30
<4> [259.911353] </TASK>
<4> [259.911355] irq event stamp: 233785
<4> [259.911356] hardirqs last enabled at (233791): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.911358] hardirqs last disabled at (233796): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.911361] softirqs last enabled at (232696): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.911363] softirqs last disabled at (232691): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.911365] ---[ end trace 0000000000000000 ]---
<6> [259.911367] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.911432] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.911438] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.912448] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [259.912561] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [259.912661] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.912867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.912957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.913047] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.913130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.913210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.913287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.913365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.913444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.913532] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.913640] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.913753] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.914760] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.925479] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.925733] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.926733] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.926811] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.926883] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.926955] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.927024] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.927092] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.927160] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.927227] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.927294] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.927361] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.927427] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.927492] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.927577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.927672] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.927741] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.927807] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.927873] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.927939] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.928005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.928083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.928158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.928231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.928305] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.928376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.928446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.928522] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.928609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.928682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.928755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.928828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.928899] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.928969] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.929045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.929121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.929196] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.929268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.929339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.929408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.929478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.929557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.929652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.929725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.929800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.929868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.929938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.930004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.930071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.930137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.930204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.930269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.930335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.930403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.930471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.930553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.930644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.930714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.930783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.930851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.930924] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.931034] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.931038] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73092, lrc_seqno=73092, guc_id=0, flags=0x73 in no process [-1]
<7> [259.931041] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.931100] ------------[ cut here ]------------
<4> [259.931101] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.931102] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:218/7009
<4> [259.931172] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.931237] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.931242] CPU: 8 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.931245] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.931246] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.931247] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.931252] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.931318] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.931320] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [259.931322] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.931323] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.931325] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.931326] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.931327] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.931329] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [259.931330] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.931331] CR2: 000072daae116910 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [259.931333] PKRU: 55555554
<4> [259.931334] Call Trace:
<4> [259.931335] <TASK>
<4> [259.931339] ? lock_acquire+0x20/0x2f0
<4> [259.931345] ? lock_release+0xd0/0x2b0
<4> [259.931350] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.931355] process_one_work+0x239/0x760
<4> [259.931362] worker_thread+0x200/0x3f0
<4> [259.931364] ? __pfx_worker_thread+0x10/0x10
<4> [259.931367] kthread+0x10d/0x150
<4> [259.931369] ? __pfx_kthread+0x10/0x10
<4> [259.931373] ret_from_fork+0x3d4/0x480
<4> [259.931375] ? __pfx_kthread+0x10/0x10
<4> [259.931378] ret_from_fork_asm+0x1a/0x30
<4> [259.931386] </TASK>
<4> [259.931387] irq event stamp: 318985
<4> [259.931388] hardirqs last enabled at (318991): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.931391] hardirqs last disabled at (318996): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.931393] softirqs last enabled at (317896): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.931395] softirqs last disabled at (317887): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.931397] ---[ end trace 0000000000000000 ]---
<5> [259.932534] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73147, lrc_seqno=73147, guc_id=0, flags=0x73 in no process [-1]
<7> [259.932545] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.932908] ------------[ cut here ]------------
<4> [259.932911] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.932914] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:218/7009
<4> [259.932991] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.933090] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.933098] CPU: 9 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<7> [259.933034] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<4> [259.933102] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.933104] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.933106] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.933114] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.933226] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.933229] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [259.933233] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.933235] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.933237] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.933240] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.933242] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.933244] FS: 0000000000000000(0000) GS:ffff8888db117000(0000) knlGS:0000000000000000
<4> [259.933247] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<7> [259.933180] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<4> [259.933249] CR2: 0000747de4099008 CR3: 0000000124092003 CR4: 0000000000f72ef0
<4> [259.933251] PKRU: 55555554
<4> [259.933253] Call Trace:
<4> [259.933255] <TASK>
<4> [259.933261] ? lock_acquire+0x20/0x2f0
<4> [259.933268] ? lock_release+0xd0/0x2b0
<4> [259.933275] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.933285] process_one_work+0x239/0x760
<4> [259.933295] worker_thread+0x200/0x3f0
<4> [259.933300] ? __pfx_worker_thread+0x10/0x10
<4> [259.933303] kthread+0x10d/0x150
<4> [259.933307] ? __pfx_kthread+0x10/0x10
<4> [259.933312] ret_from_fork+0x3d4/0x480
<4> [259.933320] ? __pfx_kthread+0x10/0x10
<4> [259.933324] ret_from_fork_asm+0x1a/0x30
<4> [259.933331] </TASK>
<4> [259.933332] irq event stamp: 321589
<4> [259.933334] hardirqs last enabled at (321595): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.933336] hardirqs last disabled at (321600): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.933339] softirqs last enabled at (317896): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.933341] softirqs last disabled at (317887): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.933343] ---[ end trace 0000000000000000 ]---
<6> [259.933345] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.933413] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.933420] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.933610] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.933812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.933895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.933979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.934058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.934139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.934218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.934297] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.934375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.934449] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.934548] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.934661] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.935668] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.945514] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.945759] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.946770] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.946845] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.946915] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.946985] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.947054] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.947122] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.947191] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.947258] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.947327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.947394] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.947462] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.947538] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.947609] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.947677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.947744] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.947811] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.947880] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.947948] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.948014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.948090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.948164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.948236] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.948308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.948378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.948448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.948528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.948599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.948671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.948744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.948815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.948886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.948956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.949032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.949109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.949184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.949256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.949327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.949397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.949467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.949548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.949621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.949692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.949761] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.949830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.949904] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.949973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.950042] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.950110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.950181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.950252] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.950322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.950395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.950465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.950548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.950619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.950688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.950758] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.950828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.950899] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.951010] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.951015] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73147, lrc_seqno=73147, guc_id=0, flags=0x73 in no process [-1]
<7> [259.951017] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.951075] ------------[ cut here ]------------
<4> [259.951076] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.951078] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:218/7009
<4> [259.951145] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.951209] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.951214] CPU: 9 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.951217] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.951218] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.951220] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.951225] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.951291] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.951293] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [259.951295] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.951297] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.951298] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.951299] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.951300] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.951302] FS: 0000000000000000(0000) GS:ffff8888db117000(0000) knlGS:0000000000000000
<4> [259.951303] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.951305] CR2: 0000747de4099008 CR3: 0000000124092003 CR4: 0000000000f72ef0
<4> [259.951306] PKRU: 55555554
<4> [259.951307] Call Trace:
<4> [259.951308] <TASK>
<4> [259.951312] ? lock_acquire+0x20/0x2f0
<4> [259.951317] ? lock_release+0xd0/0x2b0
<4> [259.951323] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.951328] process_one_work+0x239/0x760
<4> [259.951334] worker_thread+0x200/0x3f0
<4> [259.951337] ? __pfx_worker_thread+0x10/0x10
<4> [259.951339] kthread+0x10d/0x150
<4> [259.951342] ? __pfx_kthread+0x10/0x10
<4> [259.951346] ret_from_fork+0x3d4/0x480
<4> [259.951348] ? __pfx_kthread+0x10/0x10
<4> [259.951351] ret_from_fork_asm+0x1a/0x30
<4> [259.951358] </TASK>
<4> [259.951359] irq event stamp: 324685
<4> [259.951360] hardirqs last enabled at (324691): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.951363] hardirqs last disabled at (324696): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.951365] softirqs last enabled at (323708): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.951367] softirqs last disabled at (323701): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.951370] ---[ end trace 0000000000000000 ]---
<6> [259.951371] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.951439] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.951444] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.951852] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.952051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.952135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.952221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.952301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.952379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.952455] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.952542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.952625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.952700] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.952788] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.952898] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.953901] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.964620] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.964859] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.965791] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.965866] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.965937] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.966008] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.966078] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.966146] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.966213] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.966282] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.966351] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.966421] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.966489] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.966572] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.966640] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.966708] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.966776] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.966844] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.966912] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.966979] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.967048] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.967125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.967200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.967272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.967346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.967415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.967485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.967565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.967634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.967706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.967778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.967848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.967920] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.967991] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.968066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.968143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.968222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.968294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.968365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.968436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.968511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.968581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.968653] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.968724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.968793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.968859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.968933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.969001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.969070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.969139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.969209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.969277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.969346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.969418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.969488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.969570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.969640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.969710] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.969778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.969847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.969919] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.970027] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.970031] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73147, lrc_seqno=73147, guc_id=0, flags=0x73 in no process [-1]
<7> [259.970033] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.970090] ------------[ cut here ]------------
<4> [259.970092] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.970093] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:218/7009
<4> [259.970160] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.970224] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.970228] CPU: 9 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.970231] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.970232] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.970234] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.970239] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.970304] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.970306] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [259.970308] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.970309] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.970311] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.970312] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.970313] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.970315] FS: 0000000000000000(0000) GS:ffff8888db117000(0000) knlGS:0000000000000000
<4> [259.970316] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.970318] CR2: 0000747de4099008 CR3: 000000000344c005 CR4: 0000000000f72ef0
<4> [259.970319] PKRU: 55555554
<4> [259.970320] Call Trace:
<4> [259.970321] <TASK>
<4> [259.970325] ? lock_acquire+0x20/0x2f0
<4> [259.970331] ? lock_release+0xd0/0x2b0
<4> [259.970336] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.970342] process_one_work+0x239/0x760
<4> [259.970348] worker_thread+0x200/0x3f0
<4> [259.970350] ? __pfx_worker_thread+0x10/0x10
<4> [259.970353] kthread+0x10d/0x150
<4> [259.970355] ? __pfx_kthread+0x10/0x10
<4> [259.970359] ret_from_fork+0x3d4/0x480
<4> [259.970361] ? __pfx_kthread+0x10/0x10
<4> [259.970364] ret_from_fork_asm+0x1a/0x30
<4> [259.970372] </TASK>
<4> [259.970373] irq event stamp: 327781
<4> [259.970374] hardirqs last enabled at (327787): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.970377] hardirqs last disabled at (327792): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.970379] softirqs last enabled at (326798): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.970381] softirqs last disabled at (326791): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.970383] ---[ end trace 0000000000000000 ]---
<7> [259.971625] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [259.971727] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [259.971988] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73202, lrc_seqno=73202, guc_id=0, flags=0x73 in no process [-1]
<7> [259.971992] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.972053] ------------[ cut here ]------------
<4> [259.972054] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.972056] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:221/7012
<4> [259.972129] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.972193] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.972198] CPU: 10 UID: 0 PID: 7012 Comm: kworker/u64:221 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.972200] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.972201] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.972203] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.972208] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.972275] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.972277] RSP: 0018:ffffc9000752fca0 EFLAGS: 00010246
<4> [259.972279] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.972281] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.972282] RBP: ffffc9000752fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.972283] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.972284] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.972286] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [259.972287] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.972289] CR2: 00007d71ab80509c CR3: 0000000124092005 CR4: 0000000000f72ef0
<4> [259.972290] PKRU: 55555554
<4> [259.972291] Call Trace:
<4> [259.972292] <TASK>
<4> [259.972296] ? lock_acquire+0x20/0x2f0
<4> [259.972302] ? lock_release+0xd0/0x2b0
<4> [259.972307] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.972312] process_one_work+0x239/0x760
<4> [259.972319] worker_thread+0x200/0x3f0
<4> [259.972321] ? __pfx_worker_thread+0x10/0x10
<4> [259.972324] kthread+0x10d/0x150
<4> [259.972327] ? __pfx_kthread+0x10/0x10
<4> [259.972330] ret_from_fork+0x3d4/0x480
<4> [259.972332] ? __pfx_kthread+0x10/0x10
<4> [259.972336] ret_from_fork_asm+0x1a/0x30
<4> [259.972343] </TASK>
<4> [259.972344] irq event stamp: 236539
<4> [259.972345] hardirqs last enabled at (236545): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.972348] hardirqs last disabled at (236550): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.972350] softirqs last enabled at (234196): [<ffffffff81339c23>] kernel_fpu_end+0x53/0x70
<4> [259.972353] softirqs last disabled at (234194): [<ffffffff8133a334>] kernel_fpu_begin_mask+0xc4/0x120
<4> [259.972355] ---[ end trace 0000000000000000 ]---
<6> [259.972357] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.972426] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.972432] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.972479] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.972691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.972778] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.972865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.972949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.973029] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.973108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.973190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.973273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.973348] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.973439] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.973554] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.974561] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [259.984507] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [259.984753] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [259.985756] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [259.985833] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [259.985906] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [259.985979] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [259.986049] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [259.986118] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [259.986185] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [259.986254] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [259.986323] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [259.986392] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [259.986460] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [259.986538] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [259.986606] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [259.986674] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [259.986741] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [259.986808] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [259.986875] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [259.986942] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [259.987012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [259.987088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [259.987161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [259.987232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [259.987307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [259.987379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [259.987449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [259.987524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [259.987593] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [259.987664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [259.987737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [259.987807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [259.987878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [259.987949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [259.988026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [259.988104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [259.988183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [259.988259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [259.988331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [259.988402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [259.988474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [259.988551] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [259.988624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [259.988695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [259.988765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [259.988832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [259.988903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [259.988972] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [259.989044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [259.989115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [259.989185] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [259.989253] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [259.989322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [259.989393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [259.989464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [259.989543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [259.989614] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [259.989686] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [259.989754] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [259.989821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [259.989892] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [259.990002] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [259.990006] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73202, lrc_seqno=73202, guc_id=0, flags=0x73 in no process [-1]
<7> [259.990008] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [259.990065] ------------[ cut here ]------------
<4> [259.990066] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [259.990067] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:221/7012
<4> [259.990135] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [259.990199] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [259.990203] CPU: 10 UID: 0 PID: 7012 Comm: kworker/u64:221 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [259.990206] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [259.990207] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [259.990209] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [259.990214] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [259.990279] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [259.990280] RSP: 0018:ffffc9000752fca0 EFLAGS: 00010246
<4> [259.990282] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [259.990284] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [259.990285] RBP: ffffc9000752fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [259.990286] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [259.990288] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [259.990289] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [259.990291] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [259.990292] CR2: 00007d71ab80509c CR3: 0000000124092005 CR4: 0000000000f72ef0
<4> [259.990294] PKRU: 55555554
<4> [259.990295] Call Trace:
<4> [259.990296] <TASK>
<4> [259.990300] ? lock_acquire+0x20/0x2f0
<4> [259.990305] ? lock_release+0xd0/0x2b0
<4> [259.990310] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [259.990316] process_one_work+0x239/0x760
<4> [259.990322] worker_thread+0x200/0x3f0
<4> [259.990324] ? __pfx_worker_thread+0x10/0x10
<4> [259.990327] kthread+0x10d/0x150
<4> [259.990330] ? __pfx_kthread+0x10/0x10
<4> [259.990333] ret_from_fork+0x3d4/0x480
<4> [259.990335] ? __pfx_kthread+0x10/0x10
<4> [259.990338] ret_from_fork_asm+0x1a/0x30
<4> [259.990346] </TASK>
<4> [259.990347] irq event stamp: 239611
<4> [259.990348] hardirqs last enabled at (239617): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [259.990351] hardirqs last disabled at (239622): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [259.990353] softirqs last enabled at (238522): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.990356] softirqs last disabled at (238517): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [259.990358] ---[ end trace 0000000000000000 ]---
<6> [259.990360] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [259.990425] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [259.990430] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [259.991669] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [259.991772] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [259.991872] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [259.992075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [259.992160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [259.992246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [259.992329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [259.992408] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [259.992485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [259.992587] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [259.992667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [259.992741] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [259.992831] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [259.992941] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [259.993944] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [260.004505] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [260.004750] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [260.005774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [260.005849] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [260.005920] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [260.005990] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [260.006058] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [260.006127] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [260.006196] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [260.006263] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [260.006329] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [260.006397] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [260.006468] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [260.006549] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [260.006617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [260.006685] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [260.006753] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [260.006820] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [260.006888] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [260.006954] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [260.007021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [260.007097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [260.007171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [260.007243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [260.007314] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [260.007383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [260.007452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [260.007525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [260.007594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [260.007666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [260.007736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [260.007805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [260.007877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [260.007946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [260.008021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [260.008095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [260.008172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [260.008245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [260.008316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [260.008385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [260.008454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [260.008529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [260.008600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [260.008667] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [260.008735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [260.008800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [260.008870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [260.008935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [260.009003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [260.009067] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [260.009134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [260.009198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [260.009261] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [260.009327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [260.009392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [260.009458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [260.009531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [260.009597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [260.009660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [260.009722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [260.009792] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [260.009902] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [260.009906] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73202, lrc_seqno=73202, guc_id=0, flags=0x73 in no process [-1]
<7> [260.009908] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.009966] ------------[ cut here ]------------
<4> [260.009967] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.009968] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:218/7009
<4> [260.010038] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.010102] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.010107] CPU: 9 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.010110] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.010111] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.010112] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.010117] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.010184] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.010186] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [260.010188] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.010190] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.010191] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.010192] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.010193] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.010195] FS: 0000000000000000(0000) GS:ffff8888db117000(0000) knlGS:0000000000000000
<4> [260.010196] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.010198] CR2: 0000747de4099008 CR3: 0000000124092003 CR4: 0000000000f72ef0
<4> [260.010199] PKRU: 55555554
<4> [260.010200] Call Trace:
<4> [260.010202] <TASK>
<4> [260.010205] ? lock_acquire+0x20/0x2f0
<4> [260.010211] ? lock_release+0xd0/0x2b0
<4> [260.010216] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.010222] process_one_work+0x239/0x760
<4> [260.010228] worker_thread+0x200/0x3f0
<4> [260.010230] ? __pfx_worker_thread+0x10/0x10
<4> [260.010233] kthread+0x10d/0x150
<4> [260.010236] ? __pfx_kthread+0x10/0x10
<4> [260.010239] ret_from_fork+0x3d4/0x480
<4> [260.010241] ? __pfx_kthread+0x10/0x10
<4> [260.010245] ret_from_fork_asm+0x1a/0x30
<4> [260.010252] </TASK>
<4> [260.010253] irq event stamp: 331369
<4> [260.010254] hardirqs last enabled at (331375): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.010257] hardirqs last disabled at (331380): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.010259] softirqs last enabled at (330280): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.010261] softirqs last disabled at (330273): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.010264] ---[ end trace 0000000000000000 ]---
<5> [260.011654] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73257, lrc_seqno=73257, guc_id=0, flags=0x73 in no process [-1]
<7> [260.011657] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.011716] ------------[ cut here ]------------
<4> [260.011717] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.011719] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:218/7009
<4> [260.011786] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.011849] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.011853] CPU: 9 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.011856] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.011857] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.011859] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.011864] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.011927] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.011929] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [260.011931] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.011932] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.011933] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.011934] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.011936] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.011937] FS: 0000000000000000(0000) GS:ffff8888db117000(0000) knlGS:0000000000000000
<4> [260.011938] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.011940] CR2: 0000747de4099008 CR3: 0000000124092003 CR4: 0000000000f72ef0
<4> [260.011941] PKRU: 55555554
<4> [260.011942] Call Trace:
<4> [260.011943] <TASK>
<4> [260.011947] ? lock_acquire+0x20/0x2f0
<4> [260.011952] ? lock_release+0xd0/0x2b0
<4> [260.011957] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.011963] process_one_work+0x239/0x760
<4> [260.011969] worker_thread+0x200/0x3f0
<4> [260.011971] ? __pfx_worker_thread+0x10/0x10
<4> [260.011974] kthread+0x10d/0x150
<4> [260.011977] ? __pfx_kthread+0x10/0x10
<4> [260.011980] ret_from_fork+0x3d4/0x480
<4> [260.011982] ? __pfx_kthread+0x10/0x10
<4> [260.011985] ret_from_fork_asm+0x1a/0x30
<4> [260.011993] </TASK>
<4> [260.011994] irq event stamp: 332781
<4> [260.011995] hardirqs last enabled at (332787): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.011997] hardirqs last disabled at (332792): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.012000] softirqs last enabled at (330280): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.012002] softirqs last disabled at (330273): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.012004] ---[ end trace 0000000000000000 ]---
<6> [260.012006] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [260.012070] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [260.012076] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [260.012308] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [260.012404] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [260.012510] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [260.012709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [260.012791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [260.012875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [260.012954] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [260.013036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [260.013116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [260.013192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [260.013270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [260.013344] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [260.013434] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [260.013550] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [260.014557] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [260.024503] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [260.024749] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [260.025756] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [260.025831] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [260.025903] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [260.025975] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [260.026044] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [260.026111] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [260.026179] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [260.026247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [260.026316] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [260.026384] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [260.026452] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [260.026527] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [260.026594] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [260.026661] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [260.026728] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [260.026794] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [260.026861] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [260.026930] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [260.026998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [260.027073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [260.027146] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [260.027217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [260.027289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [260.027357] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [260.027424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [260.027492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [260.027576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [260.027649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [260.027724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [260.027796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [260.027868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [260.027940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [260.028015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [260.028090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [260.028165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [260.028238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [260.028308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [260.028376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [260.028446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [260.028517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [260.028590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [260.028662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [260.028730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [260.028796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [260.028867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [260.028935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [260.029005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [260.029073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [260.029143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [260.029210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [260.029279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [260.029349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [260.029418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [260.029487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [260.029571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [260.029640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [260.029707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [260.029775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [260.029846] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [260.029953] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [260.029957] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73257, lrc_seqno=73257, guc_id=0, flags=0x73 in no process [-1]
<7> [260.029959] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.030016] ------------[ cut here ]------------
<4> [260.030017] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.030019] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#9: kworker/u64:218/7009
<4> [260.030088] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.030152] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.030156] CPU: 9 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.030159] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.030160] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.030161] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.030166] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.030233] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.030234] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [260.030236] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.030238] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.030239] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.030240] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.030241] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.030243] FS: 0000000000000000(0000) GS:ffff8888db117000(0000) knlGS:0000000000000000
<4> [260.030244] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.030246] CR2: 0000747de4099008 CR3: 0000000124092003 CR4: 0000000000f72ef0
<4> [260.030247] PKRU: 55555554
<4> [260.030248] Call Trace:
<4> [260.030249] <TASK>
<4> [260.030253] ? lock_acquire+0x20/0x2f0
<4> [260.030259] ? lock_release+0xd0/0x2b0
<4> [260.030264] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.030269] process_one_work+0x239/0x760
<4> [260.030275] worker_thread+0x200/0x3f0
<4> [260.030278] ? __pfx_worker_thread+0x10/0x10
<4> [260.030281] kthread+0x10d/0x150
<4> [260.030283] ? __pfx_kthread+0x10/0x10
<4> [260.030287] ret_from_fork+0x3d4/0x480
<4> [260.030289] ? __pfx_kthread+0x10/0x10
<4> [260.030292] ret_from_fork_asm+0x1a/0x30
<4> [260.030300] </TASK>
<4> [260.030301] irq event stamp: 335873
<4> [260.030302] hardirqs last enabled at (335879): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.030305] hardirqs last disabled at (335884): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.030307] softirqs last enabled at (335000): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.030310] softirqs last disabled at (334991): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.030312] ---[ end trace 0000000000000000 ]---
<6> [260.030314] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [260.030380] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [260.030385] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [260.031682] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [260.031784] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [260.031884] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [260.032085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [260.032168] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [260.032255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [260.032335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [260.032414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [260.032491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [260.032585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [260.032666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [260.032741] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [260.032829] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [260.032939] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [260.033939] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [260.044502] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [260.044758] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [260.045768] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [260.045846] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [260.045918] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [260.045990] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [260.046060] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [260.046129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [260.046198] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [260.046267] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [260.046335] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [260.046402] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [260.046470] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [260.046549] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [260.046617] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [260.046684] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [260.046751] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [260.046818] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [260.046887] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [260.046954] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [260.047021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [260.047099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [260.047176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [260.047248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [260.047322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [260.047392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [260.047463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [260.047544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [260.047613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [260.047685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [260.047757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [260.047831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [260.047902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [260.047970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [260.048046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [260.048122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [260.048197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [260.048268] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [260.048340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [260.048411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [260.048481] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [260.048561] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [260.048636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [260.048711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [260.048783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [260.048853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [260.048928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [260.048999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [260.049069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [260.049139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [260.049211] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [260.049283] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [260.049352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [260.049424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [260.049492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [260.049575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [260.049645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [260.049713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [260.049780] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [260.049847] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [260.049918] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [260.050028] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [260.050032] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73257, lrc_seqno=73257, guc_id=0, flags=0x73 in no process [-1]
<7> [260.050035] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.050093] ------------[ cut here ]------------
<4> [260.050094] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.050095] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:218/7009
<4> [260.050165] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.050230] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.050234] CPU: 6 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.050237] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.050239] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.050240] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.050245] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.050310] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.050312] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [260.050315] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.050316] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.050317] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.050319] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.050320] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.050321] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [260.050323] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.050324] CR2: 0000614ba7466ac8 CR3: 000000015406c006 CR4: 0000000000f72ef0
<4> [260.050326] PKRU: 55555554
<4> [260.050327] Call Trace:
<4> [260.050328] <TASK>
<4> [260.050332] ? lock_acquire+0x20/0x2f0
<4> [260.050337] ? lock_release+0xd0/0x2b0
<4> [260.050343] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.050348] process_one_work+0x239/0x760
<4> [260.050354] worker_thread+0x200/0x3f0
<4> [260.050357] ? __pfx_worker_thread+0x10/0x10
<4> [260.050359] kthread+0x10d/0x150
<4> [260.050362] ? __pfx_kthread+0x10/0x10
<4> [260.050366] ret_from_fork+0x3d4/0x480
<4> [260.050368] ? __pfx_kthread+0x10/0x10
<4> [260.050371] ret_from_fork_asm+0x1a/0x30
<4> [260.050378] </TASK>
<4> [260.050379] irq event stamp: 338979
<4> [260.050381] hardirqs last enabled at (338985): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.050383] hardirqs last disabled at (338990): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.050385] softirqs last enabled at (337890): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.050388] softirqs last disabled at (337879): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.050390] ---[ end trace 0000000000000000 ]---
<5> [260.050953] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73312, lrc_seqno=73312, guc_id=0, flags=0x73 in no process [-1]
<7> [260.050956] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.051013] ------------[ cut here ]------------
<4> [260.051014] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.051016] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:218/7009
<4> [260.051084] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.051147] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.051151] CPU: 6 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.051153] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.051154] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.051156] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.051160] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.051226] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.051227] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [260.051229] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.051230] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.051232] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.051233] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.051234] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.051235] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [260.051237] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.051238] CR2: 0000614ba7466ac8 CR3: 000000015406c006 CR4: 0000000000f72ef0
<4> [260.051240] PKRU: 55555554
<4> [260.051241] Call Trace:
<4> [260.051242] <TASK>
<4> [260.051245] ? lock_acquire+0x20/0x2f0
<4> [260.051250] ? lock_release+0xd0/0x2b0
<4> [260.051255] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.051261] process_one_work+0x239/0x760
<4> [260.051267] worker_thread+0x200/0x3f0
<4> [260.051269] ? __pfx_worker_thread+0x10/0x10
<4> [260.051271] kthread+0x10d/0x150
<4> [260.051274] ? __pfx_kthread+0x10/0x10
<4> [260.051278] ret_from_fork+0x3d4/0x480
<4> [260.051280] ? __pfx_kthread+0x10/0x10
<4> [260.051283] ret_from_fork_asm+0x1a/0x30
<4> [260.051290] </TASK>
<4> [260.051291] irq event stamp: 341565
<4> [260.051293] hardirqs last enabled at (341571): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.051295] hardirqs last disabled at (341576): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.051297] softirqs last enabled at (337890): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.051299] softirqs last disabled at (337879): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.051302] ---[ end trace 0000000000000000 ]---
<6> [260.051303] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [260.051369] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [260.051375] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [260.052697] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [260.052805] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [260.052907] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [260.053116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [260.053207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [260.053295] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [260.053375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [260.053453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [260.053570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [260.053714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [260.053852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [260.053983] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [260.054125] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [260.054300] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [260.055324] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [260.065501] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [260.065751] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [260.066775] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [260.066854] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [260.066928] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [260.067000] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [260.067070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [260.067139] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [260.067208] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [260.067275] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [260.067343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [260.067409] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [260.067476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [260.067558] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [260.067650] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [260.067720] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [260.067789] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [260.067857] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [260.067925] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [260.067994] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [260.068063] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [260.068142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [260.068216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [260.068287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [260.068358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [260.068428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [260.068537] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [260.068615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [260.068684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [260.068755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [260.068825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [260.068894] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [260.068968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [260.069041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [260.069118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [260.069194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [260.069271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [260.069345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [260.069417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [260.069489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [260.069586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [260.069682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [260.069757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [260.069825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [260.069893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [260.069961] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [260.070032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [260.070100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [260.070166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [260.070232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [260.070303] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [260.070369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [260.070435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [260.070520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [260.070606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [260.070675] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [260.070742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [260.070810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [260.070877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [260.070942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [260.071011] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [260.071121] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [260.071126] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73312, lrc_seqno=73312, guc_id=0, flags=0x73 in no process [-1]
<7> [260.071128] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.071187] ------------[ cut here ]------------
<4> [260.071188] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.071189] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:220/7011
<4> [260.071257] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.071324] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.071329] CPU: 5 UID: 0 PID: 7011 Comm: kworker/u64:220 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.071333] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.071334] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.071335] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.071341] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.071406] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.071408] RSP: 0018:ffffc90007527ca0 EFLAGS: 00010246
<4> [260.071410] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.071412] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.071413] RBP: ffffc90007527db0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.071414] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.071416] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.071417] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000
<4> [260.071419] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.071420] CR2: 000072daabb8e008 CR3: 00000001ddcc3006 CR4: 0000000000f72ef0
<4> [260.071422] PKRU: 55555554
<4> [260.071423] Call Trace:
<4> [260.071424] <TASK>
<4> [260.071428] ? lock_acquire+0x20/0x2f0
<4> [260.071434] ? lock_release+0xd0/0x2b0
<4> [260.071439] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.071445] process_one_work+0x239/0x760
<4> [260.071451] worker_thread+0x200/0x3f0
<4> [260.071454] ? __pfx_worker_thread+0x10/0x10
<4> [260.071456] kthread+0x10d/0x150
<4> [260.071459] ? __pfx_kthread+0x10/0x10
<4> [260.071463] ret_from_fork+0x3d4/0x480
<4> [260.071465] ? __pfx_kthread+0x10/0x10
<4> [260.071468] ret_from_fork_asm+0x1a/0x30
<4> [260.071476] </TASK>
<4> [260.071477] irq event stamp: 461215
<4> [260.071478] hardirqs last enabled at (461221): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.071481] hardirqs last disabled at (461226): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.071483] softirqs last enabled at (460228): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.071486] softirqs last disabled at (460219): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.071488] ---[ end trace 0000000000000000 ]---
<6> [260.071490] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [260.072525] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [260.072546] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [260.072841] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [260.072943] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [260.073045] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [260.073251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [260.073336] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [260.073424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [260.073512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [260.073592] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [260.073670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [260.073749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [260.073828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [260.073902] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [260.073994] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [260.074104] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [260.075110] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [260.085500] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [260.085749] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [260.086769] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [260.086844] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [260.086916] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [260.086988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [260.087059] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [260.087130] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [260.087199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [260.087269] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [260.087338] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [260.087406] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [260.087472] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [260.087556] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [260.087626] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [260.087692] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [260.087760] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [260.087825] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [260.087890] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [260.087955] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [260.088020] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [260.088096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [260.088172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [260.088245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [260.088319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [260.088389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [260.088460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [260.088543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [260.088616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [260.088689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [260.088763] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [260.088836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [260.088907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [260.088979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [260.089056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [260.089131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [260.089207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [260.089278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [260.089350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [260.089419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [260.089493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [260.089564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [260.089635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [260.089705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [260.089774] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [260.089843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [260.089915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [260.089984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [260.090054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [260.090122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [260.090191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [260.090259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [260.090326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [260.090396] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [260.090465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [260.090549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [260.090619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [260.090691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [260.090759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [260.090826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [260.090897] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [260.091007] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [260.091011] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73312, lrc_seqno=73312, guc_id=0, flags=0x73 in no process [-1]
<7> [260.091014] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.091071] ------------[ cut here ]------------
<4> [260.091072] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.091073] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:220/7011
<4> [260.091141] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.091207] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.091213] CPU: 4 UID: 0 PID: 7011 Comm: kworker/u64:220 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.091216] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.091217] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.091218] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.091224] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.091289] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.091291] RSP: 0018:ffffc90007527ca0 EFLAGS: 00010246
<4> [260.091294] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.091295] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.091296] RBP: ffffc90007527db0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.091298] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.091299] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.091300] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000
<4> [260.091302] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.091303] CR2: 000072daabc20008 CR3: 0000000124092004 CR4: 0000000000f72ef0
<4> [260.091305] PKRU: 55555554
<4> [260.091306] Call Trace:
<4> [260.091307] <TASK>
<4> [260.091311] ? lock_acquire+0x20/0x2f0
<4> [260.091317] ? lock_release+0xd0/0x2b0
<4> [260.091322] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.091327] process_one_work+0x239/0x760
<4> [260.091334] worker_thread+0x200/0x3f0
<4> [260.091337] ? __pfx_worker_thread+0x10/0x10
<4> [260.091339] kthread+0x10d/0x150
<4> [260.091342] ? __pfx_kthread+0x10/0x10
<4> [260.091346] ret_from_fork+0x3d4/0x480
<4> [260.091348] ? __pfx_kthread+0x10/0x10
<4> [260.091351] ret_from_fork_asm+0x1a/0x30
<4> [260.091358] </TASK>
<4> [260.091360] irq event stamp: 464337
<4> [260.091361] hardirqs last enabled at (464343): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.091364] hardirqs last disabled at (464348): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.091366] softirqs last enabled at (463458): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.091369] softirqs last disabled at (463447): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.091371] ---[ end trace 0000000000000000 ]---
<5> [260.093015] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73367, lrc_seqno=73367, guc_id=0, flags=0x73 in no process [-1]
<7> [260.093021] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.093114] ------------[ cut here ]------------
<4> [260.093117] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.093119] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:220/7011
<4> [260.093227] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.093353] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.093362] CPU: 4 UID: 0 PID: 7011 Comm: kworker/u64:220 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.093366] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.093368] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.093371] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.093379] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.093485] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.093493] RSP: 0018:ffffc90007527ca0 EFLAGS: 00010246
<4> [260.093497] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.093500] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.093503] RBP: ffffc90007527db0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.093505] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.093507] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.093510] FS: 0000000000000000(0000) GS:ffff8888dae97000(0000) knlGS:0000000000000000
<4> [260.093512] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.093515] CR2: 000072daabc20008 CR3: 0000000124092004 CR4: 0000000000f72ef0
<4> [260.093518] PKRU: 55555554
<4> [260.093520] Call Trace:
<4> [260.093521] <TASK>
<4> [260.093528] ? lock_acquire+0x20/0x2f0
<4> [260.093537] ? lock_release+0xd0/0x2b0
<4> [260.093547] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.093557] process_one_work+0x239/0x760
<4> [260.093569] worker_thread+0x200/0x3f0
<4> [260.093573] ? __pfx_worker_thread+0x10/0x10
<4> [260.093578] kthread+0x10d/0x150
<4> [260.093582] ? __pfx_kthread+0x10/0x10
<4> [260.093588] ret_from_fork+0x3d4/0x480
<4> [260.093592] ? __pfx_kthread+0x10/0x10
<4> [260.093597] ret_from_fork_asm+0x1a/0x30
<4> [260.093611] </TASK>
<4> [260.093613] irq event stamp: 466487
<4> [260.093615] hardirqs last enabled at (466493): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.093619] hardirqs last disabled at (466498): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.093623] softirqs last enabled at (463458): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.093627] softirqs last disabled at (463447): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.093631] ---[ end trace 0000000000000000 ]---
<7> [260.093650] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [260.093795] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<6> [260.093932] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [260.094038] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [260.094047] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [260.094263] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [260.094520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [260.094646] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [260.094776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [260.094905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [260.095030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [260.095151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [260.095273] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [260.095397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [260.095523] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [260.095656] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [260.095811] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [260.097025] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [260.107856] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [260.108175] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [260.109368] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [260.109494] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [260.109613] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [260.109732] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [260.109851] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [260.109969] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [260.110088] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [260.110206] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [260.110324] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [260.110442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [260.110567] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [260.110687] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [260.110806] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [260.110925] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [260.111044] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [260.111162] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [260.111280] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [260.111399] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [260.111523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [260.111650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [260.111776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [260.111900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [260.112024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [260.112145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [260.112267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [260.112388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [260.112515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [260.112641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [260.112767] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [260.112892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [260.113017] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [260.113142] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [260.113274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [260.113404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [260.113539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [260.113668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [260.113795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [260.113918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [260.114051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [260.114137] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [260.114220] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [260.114296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [260.114369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [260.114440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [260.114523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [260.114594] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [260.114664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [260.114732] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [260.114801] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [260.114868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [260.114935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [260.115005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [260.115073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [260.115141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [260.115209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [260.115278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [260.115345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [260.115412] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [260.115482] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [260.115610] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [260.115614] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73367, lrc_seqno=73367, guc_id=0, flags=0x73 in no process [-1]
<7> [260.115617] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.115674] ------------[ cut here ]------------
<4> [260.115676] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.115677] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:220/7011
<4> [260.115745] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.115809] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.115814] CPU: 6 UID: 0 PID: 7011 Comm: kworker/u64:220 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.115817] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.115818] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.115819] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.115825] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.115890] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.115892] RSP: 0018:ffffc90007527ca0 EFLAGS: 00010246
<4> [260.115894] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.115896] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.115897] RBP: ffffc90007527db0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.115898] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.115899] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.115901] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [260.115902] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.115904] CR2: 0000614ba7466ac8 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [260.115905] PKRU: 55555554
<4> [260.115906] Call Trace:
<4> [260.115907] <TASK>
<4> [260.115911] ? lock_acquire+0x20/0x2f0
<4> [260.115917] ? lock_release+0xd0/0x2b0
<4> [260.115922] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.115927] process_one_work+0x239/0x760
<4> [260.115933] worker_thread+0x200/0x3f0
<4> [260.115936] ? __pfx_worker_thread+0x10/0x10
<4> [260.115939] kthread+0x10d/0x150
<4> [260.115941] ? __pfx_kthread+0x10/0x10
<4> [260.115945] ret_from_fork+0x3d4/0x480
<4> [260.115947] ? __pfx_kthread+0x10/0x10
<4> [260.115950] ret_from_fork_asm+0x1a/0x30
<4> [260.115958] </TASK>
<4> [260.115959] irq event stamp: 469631
<4> [260.115960] hardirqs last enabled at (469637): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.115963] hardirqs last disabled at (469642): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.115965] softirqs last enabled at (468790): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.115967] softirqs last disabled at (468785): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.115970] ---[ end trace 0000000000000000 ]---
<6> [260.115971] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [260.116037] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [260.116043] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [260.117273] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [260.117370] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [260.117469] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [260.117694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [260.117786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [260.117877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [260.117962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [260.118043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [260.118121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [260.118200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [260.118279] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [260.118355] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [260.118447] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [260.118570] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [260.119578] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [260.129497] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [260.129741] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [260.130686] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [260.130760] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [260.130831] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [260.130903] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [260.130973] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [260.131043] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [260.131113] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [260.131183] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [260.131252] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [260.131320] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [260.131388] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [260.131455] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [260.131538] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [260.131608] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [260.131677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [260.131747] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [260.131814] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [260.131882] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [260.131950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [260.132025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [260.132101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [260.132175] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [260.132247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [260.132316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [260.132384] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [260.132452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [260.132533] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [260.132606] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [260.132682] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [260.132760] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [260.132835] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [260.132907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [260.132983] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [260.133058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [260.133135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [260.133207] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [260.133277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [260.133346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [260.133416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [260.133490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [260.133562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [260.133633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [260.133711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [260.133785] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [260.133860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [260.133930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [260.133999] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [260.134068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [260.134138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [260.134205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [260.134272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [260.134345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [260.134415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [260.134483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [260.134570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [260.134638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [260.134705] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [260.134773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [260.134845] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [260.134957] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [260.134961] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73367, lrc_seqno=73367, guc_id=0, flags=0x73 in no process [-1]
<7> [260.134964] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.135021] ------------[ cut here ]------------
<4> [260.135022] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.135024] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:221/7012
<4> [260.135094] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.135159] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.135164] CPU: 10 UID: 0 PID: 7012 Comm: kworker/u64:221 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.135167] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.135168] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.135170] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.135175] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.135241] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.135243] RSP: 0018:ffffc9000752fca0 EFLAGS: 00010246
<4> [260.135245] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.135247] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.135248] RBP: ffffc9000752fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.135249] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.135251] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.135252] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [260.135254] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.135255] CR2: 00007d71ab80509c CR3: 0000000124092005 CR4: 0000000000f72ef0
<4> [260.135257] PKRU: 55555554
<4> [260.135258] Call Trace:
<4> [260.135259] <TASK>
<4> [260.135263] ? lock_acquire+0x20/0x2f0
<4> [260.135269] ? lock_release+0xd0/0x2b0
<4> [260.135274] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.135280] process_one_work+0x239/0x760
<4> [260.135286] worker_thread+0x200/0x3f0
<4> [260.135289] ? __pfx_worker_thread+0x10/0x10
<4> [260.135291] kthread+0x10d/0x150
<4> [260.135294] ? __pfx_kthread+0x10/0x10
<4> [260.135298] ret_from_fork+0x3d4/0x480
<4> [260.135300] ? __pfx_kthread+0x10/0x10
<4> [260.135303] ret_from_fork_asm+0x1a/0x30
<4> [260.135311] </TASK>
<4> [260.135312] irq event stamp: 243739
<4> [260.135313] hardirqs last enabled at (243745): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.135316] hardirqs last disabled at (243750): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.135318] softirqs last enabled at (242866): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.135321] softirqs last disabled at (242855): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.135323] ---[ end trace 0000000000000000 ]---
<5> [260.137028] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73422, lrc_seqno=73422, guc_id=0, flags=0x73 in no process [-1]
<7> [260.137032] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.137094] ------------[ cut here ]------------
<4> [260.137096] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.137099] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:221/7012
<4> [260.137171] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.137235] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.137240] CPU: 10 UID: 0 PID: 7012 Comm: kworker/u64:221 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.137242] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.137243] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.137244] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.137250] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.137315] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.137316] RSP: 0018:ffffc9000752fca0 EFLAGS: 00010246
<4> [260.137319] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.137320] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.137321] RBP: ffffc9000752fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.137322] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.137324] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.137325] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [260.137326] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.137328] CR2: 00007d71ab80509c CR3: 0000000124092005 CR4: 0000000000f72ef0
<4> [260.137329] PKRU: 55555554
<4> [260.137330] Call Trace:
<4> [260.137331] <TASK>
<4> [260.137335] ? lock_acquire+0x20/0x2f0
<4> [260.137341] ? lock_release+0xd0/0x2b0
<4> [260.137346] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.137351] process_one_work+0x239/0x760
<4> [260.137357] worker_thread+0x200/0x3f0
<4> [260.137360] ? __pfx_worker_thread+0x10/0x10
<4> [260.137362] kthread+0x10d/0x150
<4> [260.137365] ? __pfx_kthread+0x10/0x10
<4> [260.137369] ret_from_fork+0x3d4/0x480
<4> [260.137371] ? __pfx_kthread+0x10/0x10
<4> [260.137374] ret_from_fork_asm+0x1a/0x30
<4> [260.137381] </TASK>
<4> [260.137383] irq event stamp: 246565
<4> [260.137384] hardirqs last enabled at (246571): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.137386] hardirqs last disabled at (246576): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.137388] softirqs last enabled at (242866): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.137391] softirqs last disabled at (242855): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.137393] ---[ end trace 0000000000000000 ]---
<6> [260.137395] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [260.137459] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [260.137466] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [260.137674] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [260.137771] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [260.137871] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [260.138071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [260.138154] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [260.138240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [260.138320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [260.138397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [260.138474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [260.138570] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [260.138652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [260.138728] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [260.138819] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [260.138930] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [260.139936] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [260.150492] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [260.150740] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [260.151768] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [260.151844] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [260.151915] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [260.151986] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [260.152055] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [260.152124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [260.152193] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [260.152260] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [260.152327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [260.152393] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [260.152459] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [260.152540] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [260.152609] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [260.152675] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [260.152744] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [260.152814] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [260.152883] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [260.152948] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [260.153015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [260.153090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [260.153163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [260.153234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [260.153308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [260.153379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [260.153450] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [260.153536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [260.153607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [260.153679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [260.153752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [260.153825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [260.153896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [260.153968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [260.154045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [260.154123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [260.154200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [260.154274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [260.154347] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [260.154417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [260.154491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [260.154563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [260.154635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [260.154706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [260.154776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [260.154845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [260.154917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [260.154988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [260.155056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [260.155124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [260.155209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [260.155277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [260.155344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [260.155414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [260.155491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [260.155560] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [260.155630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [260.155700] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [260.155771] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [260.155837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [260.155910] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [260.156023] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [260.156027] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73422, lrc_seqno=73422, guc_id=0, flags=0x73 in no process [-1]
<7> [260.156029] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.156086] ------------[ cut here ]------------
<4> [260.156087] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.156089] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:221/7012
<4> [260.156156] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.156220] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.156225] CPU: 10 UID: 0 PID: 7012 Comm: kworker/u64:221 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.156228] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.156229] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.156230] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.156235] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.156302] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.156303] RSP: 0018:ffffc9000752fca0 EFLAGS: 00010246
<4> [260.156306] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.156307] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.156308] RBP: ffffc9000752fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.156309] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.156311] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.156312] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [260.156314] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.156315] CR2: 00007d71ab80509c CR3: 0000000124092005 CR4: 0000000000f72ef0
<4> [260.156316] PKRU: 55555554
<4> [260.156318] Call Trace:
<4> [260.156319] <TASK>
<4> [260.156322] ? lock_acquire+0x20/0x2f0
<4> [260.156328] ? lock_release+0xd0/0x2b0
<4> [260.156333] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.156338] process_one_work+0x239/0x760
<4> [260.156344] worker_thread+0x200/0x3f0
<4> [260.156347] ? __pfx_worker_thread+0x10/0x10
<4> [260.156349] kthread+0x10d/0x150
<4> [260.156352] ? __pfx_kthread+0x10/0x10
<4> [260.156356] ret_from_fork+0x3d4/0x480
<4> [260.156358] ? __pfx_kthread+0x10/0x10
<4> [260.156361] ret_from_fork_asm+0x1a/0x30
<4> [260.156369] </TASK>
<4> [260.156370] irq event stamp: 249669
<4> [260.156371] hardirqs last enabled at (249675): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.156374] hardirqs last disabled at (249680): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.156376] softirqs last enabled at (248578): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.156378] softirqs last disabled at (248571): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.156380] ---[ end trace 0000000000000000 ]---
<6> [260.156382] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [260.156449] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [260.156455] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [260.157686] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [260.157788] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [260.157890] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [260.158096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [260.158183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [260.158271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [260.158350] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [260.158429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [260.158508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [260.158585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [260.158664] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [260.158738] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [260.158829] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [260.158940] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [260.159941] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [260.170663] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [260.170902] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [260.171920] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [260.171997] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [260.172061] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [260.172126] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [260.172189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [260.172251] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [260.172313] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [260.172375] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [260.172436] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [260.172504] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [260.172572] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [260.172641] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [260.172710] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [260.172779] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [260.172847] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [260.172913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [260.172978] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [260.173045] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [260.173113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [260.173189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [260.173265] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [260.173339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [260.173413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [260.173486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [260.173556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [260.173628] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [260.173697] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [260.173768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [260.173841] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [260.173911] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [260.173984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [260.174060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [260.174135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [260.174210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [260.174285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [260.174358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [260.174431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [260.174508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [260.174580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [260.174649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [260.174722] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [260.174793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [260.174864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [260.174932] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [260.175005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [260.175075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [260.175144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [260.175212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [260.175281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [260.175351] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [260.175421] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [260.175497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [260.175567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [260.175636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [260.175702] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [260.175770] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [260.175837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [260.175905] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [260.175974] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [260.176082] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [260.176087] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73422, lrc_seqno=73422, guc_id=0, flags=0x73 in no process [-1]
<7> [260.176089] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.176146] ------------[ cut here ]------------
<4> [260.176147] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.176149] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:220/7011
<4> [260.176218] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.176282] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.176287] CPU: 6 UID: 0 PID: 7011 Comm: kworker/u64:220 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.176290] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.176291] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.176293] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.176298] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.176363] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.176365] RSP: 0018:ffffc90007527ca0 EFLAGS: 00010246
<4> [260.176367] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.176368] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.176370] RBP: ffffc90007527db0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.176371] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.176372] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.176373] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [260.176375] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.176377] CR2: 0000614ba7466ac8 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [260.176378] PKRU: 55555554
<4> [260.176379] Call Trace:
<4> [260.176380] <TASK>
<4> [260.176384] ? lock_acquire+0x20/0x2f0
<4> [260.176390] ? lock_release+0xd0/0x2b0
<4> [260.176395] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.176400] process_one_work+0x239/0x760
<4> [260.176406] worker_thread+0x200/0x3f0
<4> [260.176409] ? __pfx_worker_thread+0x10/0x10
<4> [260.176411] kthread+0x10d/0x150
<4> [260.176414] ? __pfx_kthread+0x10/0x10
<4> [260.176418] ret_from_fork+0x3d4/0x480
<4> [260.176420] ? __pfx_kthread+0x10/0x10
<4> [260.176423] ret_from_fork_asm+0x1a/0x30
<4> [260.176431] </TASK>
<4> [260.176432] irq event stamp: 473093
<4> [260.176433] hardirqs last enabled at (473099): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.176436] hardirqs last disabled at (473104): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.176438] softirqs last enabled at (472198): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.176441] softirqs last disabled at (472191): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.176443] ---[ end trace 0000000000000000 ]---
<5> [260.177025] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73477, lrc_seqno=73477, guc_id=0, flags=0x73 in no process [-1]
<7> [260.177027] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.177084] ------------[ cut here ]------------
<4> [260.177085] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.177087] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:220/7011
<4> [260.177152] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.177215] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.177219] CPU: 6 UID: 0 PID: 7011 Comm: kworker/u64:220 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.177222] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.177223] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.177224] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.177228] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.177293] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.177294] RSP: 0018:ffffc90007527ca0 EFLAGS: 00010246
<4> [260.177296] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.177297] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.177299] RBP: ffffc90007527db0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.177300] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.177301] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.177302] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [260.177304] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.177305] CR2: 0000614ba7466ac8 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [260.177306] PKRU: 55555554
<4> [260.177307] Call Trace:
<4> [260.177308] <TASK>
<4> [260.177312] ? lock_acquire+0x20/0x2f0
<4> [260.177317] ? lock_release+0xd0/0x2b0
<4> [260.177322] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.177328] process_one_work+0x239/0x760
<4> [260.177333] worker_thread+0x200/0x3f0
<4> [260.177336] ? __pfx_worker_thread+0x10/0x10
<4> [260.177338] kthread+0x10d/0x150
<4> [260.177341] ? __pfx_kthread+0x10/0x10
<4> [260.177345] ret_from_fork+0x3d4/0x480
<4> [260.177347] ? __pfx_kthread+0x10/0x10
<4> [260.177350] ret_from_fork_asm+0x1a/0x30
<4> [260.177357] </TASK>
<4> [260.177358] irq event stamp: 475789
<4> [260.177359] hardirqs last enabled at (475795): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.177362] hardirqs last disabled at (475800): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.177364] softirqs last enabled at (472198): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.177366] softirqs last disabled at (472191): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.177368] ---[ end trace 0000000000000000 ]---
<6> [260.177370] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [260.177435] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [260.177441] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [260.178475] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [260.178588] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [260.178687] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [260.178892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [260.178978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [260.179066] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [260.179149] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [260.179230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [260.179313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [260.179406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [260.179499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [260.179579] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [260.179670] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [260.179783] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [260.180789] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [260.191488] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [260.191740] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [260.192764] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [260.192857] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [260.192941] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [260.193015] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [260.193087] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [260.193157] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [260.193226] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [260.193297] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [260.193366] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [260.193434] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [260.193513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [260.193582] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [260.193649] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [260.193716] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [260.193783] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [260.193849] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [260.193917] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [260.193983] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [260.194049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [260.194125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [260.194198] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [260.194270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [260.194344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [260.194415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [260.194493] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [260.194562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [260.194630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [260.194704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [260.194777] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [260.194848] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [260.194918] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [260.194987] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [260.195062] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [260.195138] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [260.195214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [260.195285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [260.195355] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [260.195424] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [260.195498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [260.195568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [260.195641] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [260.195709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [260.195776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [260.195843] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [260.195914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [260.195982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [260.196051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [260.196119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [260.196188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [260.196257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [260.196326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [260.196398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [260.196467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [260.196550] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [260.196619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [260.196688] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [260.196755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [260.196822] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [260.196892] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [260.197005] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [260.197009] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73477, lrc_seqno=73477, guc_id=0, flags=0x73 in no process [-1]
<7> [260.197011] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.197068] ------------[ cut here ]------------
<4> [260.197069] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.197071] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:218/7009
<4> [260.197141] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.197206] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.197211] CPU: 11 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.197214] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.197215] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.197217] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.197222] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.197289] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.197291] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [260.197293] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.197294] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.197296] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.197297] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.197298] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.197300] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [260.197301] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.197303] CR2: 000070a320be61b4 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [260.197304] PKRU: 55555554
<4> [260.197305] Call Trace:
<4> [260.197306] <TASK>
<4> [260.197311] ? lock_acquire+0x20/0x2f0
<4> [260.197316] ? lock_release+0xd0/0x2b0
<4> [260.197322] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.197327] process_one_work+0x239/0x760
<4> [260.197334] worker_thread+0x200/0x3f0
<4> [260.197336] ? __pfx_worker_thread+0x10/0x10
<4> [260.197339] kthread+0x10d/0x150
<4> [260.197342] ? __pfx_kthread+0x10/0x10
<4> [260.197346] ret_from_fork+0x3d4/0x480
<4> [260.197348] ? __pfx_kthread+0x10/0x10
<4> [260.197351] ret_from_fork_asm+0x1a/0x30
<4> [260.197358] </TASK>
<4> [260.197360] irq event stamp: 351855
<4> [260.197361] hardirqs last enabled at (351861): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.197364] hardirqs last disabled at (351866): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.197366] softirqs last enabled at (350872): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.197369] softirqs last disabled at (350865): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.197371] ---[ end trace 0000000000000000 ]---
<6> [260.197373] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [260.197438] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [260.197444] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [260.198693] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [260.198791] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [260.199235] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [260.199447] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [260.199563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [260.199658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [260.199740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [260.199821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [260.199900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [260.199978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [260.200058] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [260.200133] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [260.200223] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [260.200333] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [260.201344] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [260.211491] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [260.211745] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [260.212773] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [260.212851] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [260.212925] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [260.212997] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [260.213067] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [260.213137] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [260.213205] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [260.213274] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [260.213344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [260.213412] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [260.213486] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [260.213579] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [260.213649] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [260.213717] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [260.213786] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [260.213853] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [260.213920] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [260.213985] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [260.214049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [260.214125] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [260.214199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [260.214269] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [260.214341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [260.214409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [260.214502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [260.214584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [260.214654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [260.214725] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [260.214798] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [260.214869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [260.214940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [260.215012] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [260.215090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [260.215166] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [260.215241] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [260.215312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [260.215381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [260.215449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [260.215531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [260.215630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [260.215704] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [260.215775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [260.215846] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [260.215914] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [260.215985] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [260.216053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [260.216120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [260.216187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [260.216256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [260.216321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [260.216386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [260.216454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [260.216536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [260.216624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [260.216694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [260.216764] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [260.216831] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [260.216898] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [260.216970] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [260.217080] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [260.217085] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73477, lrc_seqno=73477, guc_id=0, flags=0x73 in no process [-1]
<7> [260.217087] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.217146] ------------[ cut here ]------------
<4> [260.217147] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.217149] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:220/7011
<4> [260.217217] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.217284] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.217289] CPU: 8 UID: 0 PID: 7011 Comm: kworker/u64:220 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.217292] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.217293] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.217294] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.217300] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.217365] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.217367] RSP: 0018:ffffc90007527ca0 EFLAGS: 00010246
<4> [260.217369] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.217371] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.217372] RBP: ffffc90007527db0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.217373] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.217374] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.217376] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [260.217377] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.217379] CR2: 000072daae116910 CR3: 000000015406c005 CR4: 0000000000f72ef0
<4> [260.217380] PKRU: 55555554
<4> [260.217381] Call Trace:
<4> [260.217382] <TASK>
<4> [260.217386] ? lock_acquire+0x20/0x2f0
<4> [260.217392] ? lock_release+0xd0/0x2b0
<4> [260.217397] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.217403] process_one_work+0x239/0x760
<4> [260.217410] worker_thread+0x200/0x3f0
<4> [260.217413] ? __pfx_worker_thread+0x10/0x10
<4> [260.217415] kthread+0x10d/0x150
<4> [260.217418] ? __pfx_kthread+0x10/0x10
<4> [260.217422] ret_from_fork+0x3d4/0x480
<4> [260.217424] ? __pfx_kthread+0x10/0x10
<4> [260.217427] ret_from_fork_asm+0x1a/0x30
<4> [260.217434] </TASK>
<4> [260.217436] irq event stamp: 479255
<4> [260.217437] hardirqs last enabled at (479261): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.217440] hardirqs last disabled at (479266): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.217442] softirqs last enabled at (478272): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.217444] softirqs last disabled at (478265): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.217447] ---[ end trace 0000000000000000 ]---
<5> [260.218107] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73532, lrc_seqno=73532, guc_id=0, flags=0x73 in no process [-1]
<7> [260.218110] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.218171] ------------[ cut here ]------------
<4> [260.218172] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.218173] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:220/7011
<4> [260.218242] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.218306] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.218311] CPU: 8 UID: 0 PID: 7011 Comm: kworker/u64:220 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.218313] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.218314] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.218316] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.218321] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.218388] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.218389] RSP: 0018:ffffc90007527ca0 EFLAGS: 00010246
<4> [260.218392] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.218393] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.218394] RBP: ffffc90007527db0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.218395] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.218397] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.218398] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [260.218399] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.218401] CR2: 000072daae116910 CR3: 000000015406c005 CR4: 0000000000f72ef0
<4> [260.218402] PKRU: 55555554
<4> [260.218403] Call Trace:
<4> [260.218405] <TASK>
<4> [260.218408] ? lock_acquire+0x20/0x2f0
<4> [260.218413] ? lock_release+0xd0/0x2b0
<4> [260.218419] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.218424] process_one_work+0x239/0x760
<4> [260.218430] worker_thread+0x200/0x3f0
<4> [260.218433] ? __pfx_worker_thread+0x10/0x10
<4> [260.218435] kthread+0x10d/0x150
<4> [260.218438] ? __pfx_kthread+0x10/0x10
<4> [260.218442] ret_from_fork+0x3d4/0x480
<4> [260.218444] ? __pfx_kthread+0x10/0x10
<4> [260.218447] ret_from_fork_asm+0x1a/0x30
<4> [260.218454] </TASK>
<4> [260.218456] irq event stamp: 481973
<4> [260.218457] hardirqs last enabled at (481979): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.218459] hardirqs last disabled at (481984): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.218461] softirqs last enabled at (478272): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.218464] softirqs last disabled at (478265): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.218466] ---[ end trace 0000000000000000 ]---
<6> [260.218468] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [260.219359] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [260.219366] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [260.219448] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [260.219578] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [260.219684] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [260.219887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [260.219973] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [260.220060] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [260.220141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [260.220219] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [260.220296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [260.220376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [260.220457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [260.220541] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [260.220633] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [260.220745] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [260.221753] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [260.231482] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [260.231731] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [260.232755] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [260.232831] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [260.232902] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [260.232972] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [260.233041] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [260.233109] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [260.233177] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [260.233245] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [260.233311] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [260.233380] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [260.233446] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [260.233524] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [260.233593] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [260.233660] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [260.233730] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [260.233799] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [260.233868] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [260.233934] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [260.234002] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [260.234077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [260.234153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [260.234226] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [260.234300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [260.234371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [260.234442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [260.234525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [260.234599] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [260.234671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [260.234745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [260.234816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [260.234888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [260.234959] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [260.235035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [260.235109] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [260.235183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [260.235255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [260.235328] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [260.235398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [260.235469] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [260.235575] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [260.235647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [260.235719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [260.235787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [260.235853] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [260.235925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [260.235995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [260.236065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [260.236131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [260.236199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [260.236266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [260.236333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [260.236404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [260.236478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [260.236549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [260.236615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [260.236685] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [260.236752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [260.236820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [260.236892] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [260.237002] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [260.237006] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73532, lrc_seqno=73532, guc_id=0, flags=0x73 in no process [-1]
<7> [260.237008] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.237065] ------------[ cut here ]------------
<4> [260.237067] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.237068] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:218/7009
<4> [260.237135] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.237202] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.237207] CPU: 10 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.237210] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.237211] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.237212] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.237218] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.237283] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.237285] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [260.237287] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.237288] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.237290] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.237291] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.237292] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.237293] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [260.237295] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.237296] CR2: 00007d71ab80509c CR3: 0000000124092005 CR4: 0000000000f72ef0
<4> [260.237298] PKRU: 55555554
<4> [260.237299] Call Trace:
<4> [260.237300] <TASK>
<4> [260.237304] ? lock_acquire+0x20/0x2f0
<4> [260.237310] ? lock_release+0xd0/0x2b0
<4> [260.237315] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.237320] process_one_work+0x239/0x760
<4> [260.237327] worker_thread+0x200/0x3f0
<4> [260.237329] ? __pfx_worker_thread+0x10/0x10
<4> [260.237332] kthread+0x10d/0x150
<4> [260.237335] ? __pfx_kthread+0x10/0x10
<4> [260.237338] ret_from_fork+0x3d4/0x480
<4> [260.237340] ? __pfx_kthread+0x10/0x10
<4> [260.237344] ret_from_fork_asm+0x1a/0x30
<4> [260.237351] </TASK>
<4> [260.237352] irq event stamp: 357279
<4> [260.237353] hardirqs last enabled at (357285): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.237356] hardirqs last disabled at (357290): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.237358] softirqs last enabled at (356302): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.237361] softirqs last disabled at (356133): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.237363] ---[ end trace 0000000000000000 ]---
<6> [260.237365] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [260.237430] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [260.237436] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [260.238448] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [260.238559] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [260.238658] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [260.238863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [260.238952] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [260.239040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [260.239122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [260.239202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [260.239281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [260.239362] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [260.239443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [260.239527] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [260.239623] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [260.239734] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [260.240738] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [260.250480] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [260.250725] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [260.251738] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [260.251805] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [260.251870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [260.251936] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [260.252001] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [260.252064] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [260.252127] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [260.252188] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [260.252250] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [260.252314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [260.252376] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [260.252439] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [260.252514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [260.252583] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [260.252652] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [260.252718] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [260.252784] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [260.252850] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [260.252915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [260.252992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [260.253065] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [260.253133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [260.253203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [260.253270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [260.253337] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [260.253405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [260.253471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [260.253556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [260.253626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [260.253694] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [260.253762] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [260.253832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [260.253906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [260.253979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [260.254052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [260.254122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [260.254191] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [260.254256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [260.254321] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [260.254386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [260.254453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [260.254530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [260.254596] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [260.254662] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [260.254731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [260.254796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [260.254863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [260.254927] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [260.254992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [260.255056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [260.255119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [260.255188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [260.255255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [260.255326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [260.255393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [260.255463] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [260.255545] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [260.255610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [260.255680] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [260.255789] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [260.255794] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73532, lrc_seqno=73532, guc_id=0, flags=0x73 in no process [-1]
<7> [260.255796] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.255853] ------------[ cut here ]------------
<4> [260.255854] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.255856] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:221/7012
<4> [260.255923] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.255988] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.255993] CPU: 6 UID: 0 PID: 7012 Comm: kworker/u64:221 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.255996] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.255997] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.255998] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.256004] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.256072] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.256073] RSP: 0018:ffffc9000752fca0 EFLAGS: 00010246
<4> [260.256076] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.256077] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.256079] RBP: ffffc9000752fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.256080] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.256081] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.256083] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [260.256084] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.256085] CR2: 0000614ba7466ac8 CR3: 0000000122329005 CR4: 0000000000f72ef0
<4> [260.256087] PKRU: 55555554
<4> [260.256088] Call Trace:
<4> [260.256089] <TASK>
<4> [260.256093] ? lock_acquire+0x20/0x2f0
<4> [260.256098] ? lock_release+0xd0/0x2b0
<4> [260.256104] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.256109] process_one_work+0x239/0x760
<4> [260.256115] worker_thread+0x200/0x3f0
<4> [260.256118] ? __pfx_worker_thread+0x10/0x10
<4> [260.256120] kthread+0x10d/0x150
<4> [260.256123] ? __pfx_kthread+0x10/0x10
<4> [260.256127] ret_from_fork+0x3d4/0x480
<4> [260.256129] ? __pfx_kthread+0x10/0x10
<4> [260.256132] ret_from_fork_asm+0x1a/0x30
<4> [260.256139] </TASK>
<4> [260.256140] irq event stamp: 255549
<4> [260.256142] hardirqs last enabled at (255555): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.256145] hardirqs last disabled at (255560): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.256147] softirqs last enabled at (254688): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.256149] softirqs last disabled at (254677): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.256152] ---[ end trace 0000000000000000 ]---
<7> [260.257611] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<5> [260.257689] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73587, lrc_seqno=73587, guc_id=0, flags=0x73 in no process [-1]
<7> [260.257692] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.257751] ------------[ cut here ]------------
<4> [260.257753] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<7> [260.257712] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<4> [260.257754] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:218/7009
<4> [260.257825] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.257889] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.257894] CPU: 10 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.257896] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.257898] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.257899] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.257904] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.257969] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.257971] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [260.257973] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.257975] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.257976] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.257977] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.257978] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.257980] FS: 0000000000000000(0000) GS:ffff8888db197000(0000) knlGS:0000000000000000
<4> [260.257981] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.257982] CR2: 00007d71ab80509c CR3: 0000000122329006 CR4: 0000000000f72ef0
<4> [260.257984] PKRU: 55555554
<4> [260.257985] Call Trace:
<4> [260.257986] <TASK>
<4> [260.257990] ? lock_acquire+0x20/0x2f0
<4> [260.257995] ? lock_release+0xd0/0x2b0
<4> [260.258000] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.258006] process_one_work+0x239/0x760
<4> [260.258012] worker_thread+0x200/0x3f0
<4> [260.258015] ? __pfx_worker_thread+0x10/0x10
<4> [260.258017] kthread+0x10d/0x150
<4> [260.258020] ? __pfx_kthread+0x10/0x10
<4> [260.258024] ret_from_fork+0x3d4/0x480
<4> [260.258026] ? __pfx_kthread+0x10/0x10
<4> [260.258029] ret_from_fork_asm+0x1a/0x30
<4> [260.258036] </TASK>
<4> [260.258038] irq event stamp: 358741
<4> [260.258039] hardirqs last enabled at (358747): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.258041] hardirqs last disabled at (358752): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.258044] softirqs last enabled at (357398): [<ffffffff81339c23>] kernel_fpu_end+0x53/0x70
<4> [260.258046] softirqs last disabled at (357396): [<ffffffff8133a334>] kernel_fpu_begin_mask+0xc4/0x120
<4> [260.258048] ---[ end trace 0000000000000000 ]---
<6> [260.258050] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [260.258115] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [260.258121] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [260.258178] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [260.258387] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [260.258483] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [260.258574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [260.258657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [260.258736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [260.258814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [260.258892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [260.258971] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [260.259047] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [260.259137] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [260.259247] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [260.260253] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [260.270486] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [260.270736] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [260.271766] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [260.271842] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [260.271913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [260.271984] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [260.272054] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [260.272122] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [260.272189] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [260.272256] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [260.272325] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [260.272392] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [260.272458] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [260.272539] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [260.272606] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [260.272672] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [260.272739] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [260.272809] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [260.272876] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [260.272942] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [260.273009] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [260.273085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [260.273159] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [260.273231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [260.273302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [260.273373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [260.273442] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [260.273520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [260.273589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [260.273660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [260.273731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [260.273799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [260.273868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [260.273938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [260.274013] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [260.274087] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [260.274161] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [260.274232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [260.274301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [260.274367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [260.274435] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [260.274510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [260.274580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [260.274650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [260.274718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [260.274784] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [260.274855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [260.274921] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [260.274989] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [260.275055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [260.275123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [260.275189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [260.275256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [260.275327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [260.275393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [260.275462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [260.275543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [260.275613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [260.275679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [260.275745] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [260.275814] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [260.275922] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [260.275926] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73587, lrc_seqno=73587, guc_id=0, flags=0x73 in no process [-1]
<7> [260.275929] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.275985] ------------[ cut here ]------------
<4> [260.275986] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.275988] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:220/7011
<4> [260.276055] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.276120] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.276125] CPU: 8 UID: 0 PID: 7011 Comm: kworker/u64:220 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.276128] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.276129] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.276131] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.276136] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.276202] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.276203] RSP: 0018:ffffc90007527ca0 EFLAGS: 00010246
<4> [260.276206] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.276207] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.276208] RBP: ffffc90007527db0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.276209] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.276211] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.276212] FS: 0000000000000000(0000) GS:ffff8888db097000(0000) knlGS:0000000000000000
<4> [260.276214] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.276215] CR2: 000072daae116910 CR3: 000000015406c005 CR4: 0000000000f72ef0
<4> [260.276216] PKRU: 55555554
<4> [260.276218] Call Trace:
<4> [260.276219] <TASK>
<4> [260.276223] ? lock_acquire+0x20/0x2f0
<4> [260.276228] ? lock_release+0xd0/0x2b0
<4> [260.276234] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.276240] process_one_work+0x239/0x760
<4> [260.276246] worker_thread+0x200/0x3f0
<4> [260.276248] ? __pfx_worker_thread+0x10/0x10
<4> [260.276251] kthread+0x10d/0x150
<4> [260.276254] ? __pfx_kthread+0x10/0x10
<4> [260.276257] ret_from_fork+0x3d4/0x480
<4> [260.276259] ? __pfx_kthread+0x10/0x10
<4> [260.276263] ret_from_fork_asm+0x1a/0x30
<4> [260.276270] </TASK>
<4> [260.276271] irq event stamp: 487377
<4> [260.276272] hardirqs last enabled at (487383): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.276275] hardirqs last disabled at (487388): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.276277] softirqs last enabled at (486184): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.276279] softirqs last disabled at (486179): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.276282] ---[ end trace 0000000000000000 ]---
<6> [260.276283] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [260.276349] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [260.276355] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [260.277682] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [260.277781] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [260.277883] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [260.278083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [260.278164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [260.278248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [260.278326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [260.278406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [260.278490] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [260.278567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [260.278647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [260.278719] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [260.278809] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [260.278918] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [260.279920] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [260.290637] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [260.290877] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [260.291910] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [260.291985] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [260.292051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [260.292116] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [260.292178] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [260.292240] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [260.292300] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [260.292362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [260.292424] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [260.292491] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [260.292561] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [260.292629] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [260.292695] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [260.292764] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [260.292831] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [260.292899] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [260.292966] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [260.293035] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [260.293104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [260.293180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [260.293256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [260.293329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [260.293403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [260.293479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [260.293548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [260.293619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [260.293687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [260.293757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [260.293827] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [260.293895] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [260.293965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [260.294033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [260.294108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [260.294183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [260.294258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [260.294329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [260.294400] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [260.294473] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [260.294542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [260.294611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [260.294684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [260.294756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [260.294825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [260.294892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [260.294963] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [260.295032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [260.295101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [260.295169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [260.295239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [260.295307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [260.295374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [260.295444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [260.295523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [260.295591] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [260.295658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [260.295727] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [260.295796] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [260.295864] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [260.295935] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [260.296046] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [260.296050] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73587, lrc_seqno=73587, guc_id=0, flags=0x73 in no process [-1]
<7> [260.296052] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.296110] ------------[ cut here ]------------
<4> [260.296111] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.296112] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:220/7011
<4> [260.296179] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.296244] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.296248] CPU: 6 UID: 0 PID: 7011 Comm: kworker/u64:220 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.296251] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.296252] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.296254] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.296259] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.296323] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.296325] RSP: 0018:ffffc90007527ca0 EFLAGS: 00010246
<4> [260.296327] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.296328] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.296330] RBP: ffffc90007527db0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.296331] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.296332] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.296334] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [260.296335] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.296337] CR2: 0000614ba7466ac8 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [260.296338] PKRU: 55555554
<4> [260.296339] Call Trace:
<4> [260.296340] <TASK>
<4> [260.296344] ? lock_acquire+0x20/0x2f0
<4> [260.296349] ? lock_release+0xd0/0x2b0
<4> [260.296355] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.296360] process_one_work+0x239/0x760
<4> [260.296366] worker_thread+0x200/0x3f0
<4> [260.296369] ? __pfx_worker_thread+0x10/0x10
<4> [260.296371] kthread+0x10d/0x150
<4> [260.296375] ? __pfx_kthread+0x10/0x10
<4> [260.296378] ret_from_fork+0x3d4/0x480
<4> [260.296380] ? __pfx_kthread+0x10/0x10
<4> [260.296383] ret_from_fork_asm+0x1a/0x30
<4> [260.296391] </TASK>
<4> [260.296392] irq event stamp: 490489
<4> [260.296393] hardirqs last enabled at (490495): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.296396] hardirqs last disabled at (490500): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.296398] softirqs last enabled at (489602): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.296401] softirqs last disabled at (489597): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.296403] ---[ end trace 0000000000000000 ]---
<5> [260.297013] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73642, lrc_seqno=73642, guc_id=0, flags=0x73 in no process [-1]
<7> [260.297021] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.297186] ------------[ cut here ]------------
<4> [260.297189] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.297191] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#14: kworker/u64:218/7009
<4> [260.297308] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.297409] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.297416] CPU: 14 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.297421] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.297422] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.297424] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.297433] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.297557] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.297561] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [260.297565] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.297568] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.297570] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.297572] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.297574] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.297576] FS: 0000000000000000(0000) GS:ffff8888db397000(0000) knlGS:0000000000000000
<4> [260.297579] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.297581] CR2: 00007d71ab4a9088 CR3: 000000000344c003 CR4: 0000000000f72ef0
<4> [260.297583] PKRU: 55555554
<4> [260.297586] Call Trace:
<4> [260.297588] <TASK>
<4> [260.297595] ? lock_acquire+0x20/0x2f0
<4> [260.297606] ? lock_release+0xd0/0x2b0
<4> [260.297615] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.297624] process_one_work+0x239/0x760
<4> [260.297636] worker_thread+0x200/0x3f0
<4> [260.297640] ? __pfx_worker_thread+0x10/0x10
<4> [260.297644] kthread+0x10d/0x150
<4> [260.297649] ? __pfx_kthread+0x10/0x10
<4> [260.297655] ret_from_fork+0x3d4/0x480
<4> [260.297659] ? __pfx_kthread+0x10/0x10
<4> [260.297665] ret_from_fork_asm+0x1a/0x30
<4> [260.297677] </TASK>
<4> [260.297679] irq event stamp: 361289
<4> [260.297681] hardirqs last enabled at (361295): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.297687] hardirqs last disabled at (361300): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.297691] softirqs last enabled at (361128): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.297695] softirqs last disabled at (361121): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.297699] ---[ end trace 0000000000000000 ]---
<6> [260.297703] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [260.297818] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [260.297827] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [260.297901] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [260.298001] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [260.298106] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [260.298365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [260.298507] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [260.298644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [260.298775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [260.298906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [260.299035] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [260.299167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [260.299301] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [260.299429] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [260.299574] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [260.299739] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [260.301085] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [260.311477] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [260.311787] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [260.313182] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [260.313302] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [260.313419] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [260.313545] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [260.313664] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [260.313783] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [260.313901] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [260.314020] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [260.314138] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [260.314257] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [260.314375] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [260.314507] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [260.314587] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [260.314657] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [260.314724] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [260.314788] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [260.314853] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [260.314919] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [260.314982] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [260.315053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [260.315122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [260.315188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [260.315255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [260.315319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [260.315385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [260.315451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [260.315544] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [260.315615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [260.315683] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [260.315747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [260.315811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [260.315876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [260.315946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [260.316015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [260.316084] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [260.316150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [260.316214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [260.316276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [260.316338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [260.316399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [260.316464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [260.316547] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [260.316613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [260.316674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [260.316739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [260.316803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [260.316867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [260.316928] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [260.316992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [260.317052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [260.317114] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [260.317179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [260.317242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [260.317306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [260.317367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [260.317429] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [260.317501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [260.317569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [260.317633] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [260.317738] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [260.317743] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73642, lrc_seqno=73642, guc_id=0, flags=0x73 in no process [-1]
<7> [260.317745] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.317797] ------------[ cut here ]------------
<4> [260.317798] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.317799] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:218/7009
<4> [260.317864] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.317923] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.317927] CPU: 6 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.317929] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.317931] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.317932] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.317937] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.317997] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.317998] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [260.318000] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.318002] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.318003] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.318004] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.318005] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.318006] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [260.318008] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.318009] CR2: 0000614ba7466ac8 CR3: 000000015406c006 CR4: 0000000000f72ef0
<4> [260.318011] PKRU: 55555554
<4> [260.318012] Call Trace:
<4> [260.318013] <TASK>
<4> [260.318016] ? lock_acquire+0x20/0x2f0
<4> [260.318021] ? lock_release+0xd0/0x2b0
<4> [260.318026] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.318031] process_one_work+0x239/0x760
<4> [260.318037] worker_thread+0x200/0x3f0
<4> [260.318039] ? __pfx_worker_thread+0x10/0x10
<4> [260.318041] kthread+0x10d/0x150
<4> [260.318044] ? __pfx_kthread+0x10/0x10
<4> [260.318047] ret_from_fork+0x3d4/0x480
<4> [260.318049] ? __pfx_kthread+0x10/0x10
<4> [260.318052] ret_from_fork_asm+0x1a/0x30
<4> [260.318058] </TASK>
<4> [260.318059] irq event stamp: 364455
<4> [260.318060] hardirqs last enabled at (364461): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.318063] hardirqs last disabled at (364466): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.318065] softirqs last enabled at (363492): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.318067] softirqs last disabled at (363485): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.318069] ---[ end trace 0000000000000000 ]---
<6> [260.318071] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [260.318134] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [260.318141] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [260.318324] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [260.318520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [260.318597] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [260.318672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [260.318744] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [260.318815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [260.318886] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [260.318956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [260.319027] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [260.319094] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [260.319176] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [260.319279] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [260.320271] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [260.330474] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [260.330718] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [260.331963] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [260.332033] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [260.332100] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [260.332166] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [260.332232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [260.332296] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [260.332359] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [260.332420] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [260.332491] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [260.332556] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [260.332621] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [260.332682] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [260.332744] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [260.332806] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [260.332867] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [260.332927] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [260.332988] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [260.333047] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [260.333107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [260.333177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [260.333246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [260.333311] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [260.333376] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [260.333439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [260.333526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [260.333590] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [260.333652] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [260.333716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [260.333783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [260.333850] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [260.333913] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [260.333976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [260.334044] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [260.334113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [260.334182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [260.334247] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [260.334310] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [260.334370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [260.334431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [260.334502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [260.334565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [260.334627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [260.334689] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [260.334750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [260.334813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [260.334873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [260.334934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [260.334993] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [260.335054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [260.335113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [260.335171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [260.335232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [260.335292] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [260.335352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [260.335411] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [260.335477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [260.335539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [260.335600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [260.335664] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [260.335770] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [260.335773] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73642, lrc_seqno=73642, guc_id=0, flags=0x73 in no process [-1]
<7> [260.335776] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.335828] ------------[ cut here ]------------
<4> [260.335829] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.335830] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:218/7009
<4> [260.335893] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.335952] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.335956] CPU: 6 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.335959] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.335960] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.335961] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.335966] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.336027] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.336029] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [260.336031] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.336032] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.336033] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.336034] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.336035] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.336036] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [260.336038] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.336039] CR2: 0000614ba7466ac8 CR3: 000000015406c006 CR4: 0000000000f72ef0
<4> [260.336040] PKRU: 55555554
<4> [260.336041] Call Trace:
<4> [260.336043] <TASK>
<4> [260.336046] ? lock_acquire+0x20/0x2f0
<4> [260.336051] ? lock_release+0xd0/0x2b0
<4> [260.336056] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.336061] process_one_work+0x239/0x760
<4> [260.336067] worker_thread+0x200/0x3f0
<4> [260.336069] ? __pfx_worker_thread+0x10/0x10
<4> [260.336072] kthread+0x10d/0x150
<4> [260.336074] ? __pfx_kthread+0x10/0x10
<4> [260.336078] ret_from_fork+0x3d4/0x480
<4> [260.336079] ? __pfx_kthread+0x10/0x10
<4> [260.336082] ret_from_fork_asm+0x1a/0x30
<4> [260.336089] </TASK>
<4> [260.336090] irq event stamp: 367627
<4> [260.336091] hardirqs last enabled at (367633): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.336094] hardirqs last disabled at (367638): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.336096] softirqs last enabled at (366650): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.336098] softirqs last disabled at (366643): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.336100] ---[ end trace 0000000000000000 ]---
<5> [260.337476] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73697, lrc_seqno=73697, guc_id=0, flags=0x73 in no process [-1]
<7> [260.337479] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.337540] ------------[ cut here ]------------
<4> [260.337541] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.337542] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:218/7009
<4> [260.337617] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.337680] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.337685] CPU: 6 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.337688] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.337689] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.337690] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.337695] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.337761] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.337763] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [260.337765] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.337766] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.337768] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.337769] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.337770] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.337772] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [260.337773] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.337775] CR2: 0000614ba7466ac8 CR3: 000000015406c006 CR4: 0000000000f72ef0
<4> [260.337776] PKRU: 55555554
<4> [260.337777] Call Trace:
<4> [260.337778] <TASK>
<4> [260.337782] ? lock_acquire+0x20/0x2f0
<4> [260.337787] ? lock_release+0xd0/0x2b0
<4> [260.337792] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.337798] process_one_work+0x239/0x760
<4> [260.337804] worker_thread+0x200/0x3f0
<4> [260.337806] ? __pfx_worker_thread+0x10/0x10
<4> [260.337809] kthread+0x10d/0x150
<4> [260.337811] ? __pfx_kthread+0x10/0x10
<4> [260.337815] ret_from_fork+0x3d4/0x480
<4> [260.337817] ? __pfx_kthread+0x10/0x10
<4> [260.337820] ret_from_fork_asm+0x1a/0x30
<4> [260.337828] </TASK>
<4> [260.337829] irq event stamp: 369327
<4> [260.337830] hardirqs last enabled at (369333): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.337832] hardirqs last disabled at (369338): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.337835] softirqs last enabled at (366650): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.337837] softirqs last disabled at (366643): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.337839] ---[ end trace 0000000000000000 ]---
<6> [260.337841] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [260.337906] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [260.337913] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [260.338129] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [260.338229] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [260.338330] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [260.338540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [260.338626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [260.338711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [260.338793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [260.338875] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [260.338953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [260.339034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [260.339113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [260.339193] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [260.339284] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [260.339397] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [260.340402] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [260.350471] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [260.350715] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [260.351938] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [260.352006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [260.352070] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [260.352136] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [260.352199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [260.352262] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [260.352324] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [260.352386] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [260.352448] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [260.352523] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [260.352584] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [260.352645] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [260.352707] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [260.352769] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [260.352831] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [260.352893] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [260.352955] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [260.353014] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [260.353074] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [260.353143] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [260.353210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [260.353276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [260.353341] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [260.353405] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [260.353479] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [260.353548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [260.353612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [260.353676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [260.353741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [260.353807] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [260.353873] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [260.353937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [260.354005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [260.354075] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [260.354144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [260.354209] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [260.354272] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [260.354332] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [260.354394] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [260.354453] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [260.354554] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [260.354624] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [260.354687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [260.354747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [260.354812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [260.354872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [260.354935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [260.354996] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [260.355061] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [260.355122] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [260.355182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [260.355245] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [260.355306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [260.355367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [260.355426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [260.355501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [260.355572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [260.355634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [260.355697] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [260.355803] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [260.355806] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73697, lrc_seqno=73697, guc_id=0, flags=0x73 in no process [-1]
<7> [260.355808] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.355861] ------------[ cut here ]------------
<4> [260.355862] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.355863] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:218/7009
<4> [260.355926] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.355984] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.355989] CPU: 6 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.355991] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.355992] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.355994] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.355998] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.356058] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.356059] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [260.356061] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.356063] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.356064] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.356065] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.356066] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.356067] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [260.356068] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.356070] CR2: 0000614ba7466ac8 CR3: 000000015406c006 CR4: 0000000000f72ef0
<4> [260.356071] PKRU: 55555554
<4> [260.356072] Call Trace:
<4> [260.356073] <TASK>
<4> [260.356077] ? lock_acquire+0x20/0x2f0
<4> [260.356082] ? lock_release+0xd0/0x2b0
<4> [260.356086] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.356092] process_one_work+0x239/0x760
<4> [260.356097] worker_thread+0x200/0x3f0
<4> [260.356100] ? __pfx_worker_thread+0x10/0x10
<4> [260.356102] kthread+0x10d/0x150
<4> [260.356104] ? __pfx_kthread+0x10/0x10
<4> [260.356108] ret_from_fork+0x3d4/0x480
<4> [260.356109] ? __pfx_kthread+0x10/0x10
<4> [260.356112] ret_from_fork_asm+0x1a/0x30
<4> [260.356119] </TASK>
<4> [260.356120] irq event stamp: 372435
<4> [260.356121] hardirqs last enabled at (372441): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.356124] hardirqs last disabled at (372446): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.356126] softirqs last enabled at (371568): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.356128] softirqs last disabled at (371561): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.356130] ---[ end trace 0000000000000000 ]---
<6> [260.356131] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [260.356191] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [260.356196] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [260.356366] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [260.356562] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [260.356638] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [260.356717] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [260.356791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [260.356862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [260.356931] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [260.357001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [260.357073] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [260.357140] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [260.357223] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [260.357329] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [260.358320] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [260.369033] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [260.369272] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [260.370503] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [260.370572] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [260.370637] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [260.370702] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [260.370768] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [260.370831] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [260.370895] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [260.370959] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [260.371021] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [260.371083] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [260.371145] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [260.371206] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [260.371268] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [260.371330] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [260.371391] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [260.371452] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [260.371536] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [260.371600] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [260.371660] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [260.371730] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [260.371799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [260.371866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [260.371933] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [260.372001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [260.372068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [260.372135] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [260.372200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [260.372267] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [260.372334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [260.372399] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [260.372474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [260.372539] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [260.372608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [260.372679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [260.372748] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [260.372816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [260.372882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [260.372944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [260.373008] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [260.373071] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [260.373136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [260.373200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [260.373264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [260.373326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [260.373393] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [260.373456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [260.373536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [260.373600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [260.373665] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [260.373726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [260.373787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [260.373852] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [260.373915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [260.373979] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [260.374041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [260.374104] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [260.374165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [260.374227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [260.374291] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [260.374396] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [260.374399] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73697, lrc_seqno=73697, guc_id=0, flags=0x73 in no process [-1]
<7> [260.374401] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.374453] ------------[ cut here ]------------
<4> [260.374454] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.374455] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:218/7009
<4> [260.374533] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.374593] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.374598] CPU: 6 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.374600] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.374601] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.374602] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.374607] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.374666] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.374668] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [260.374671] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.374673] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.374675] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.374677] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.374679] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.374682] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [260.374685] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.374687] CR2: 0000614ba7466ac8 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [260.374690] PKRU: 55555554
<4> [260.374693] Call Trace:
<4> [260.374695] <TASK>
<4> [260.374703] ? lock_acquire+0x20/0x2f0
<4> [260.374713] ? lock_release+0xd0/0x2b0
<4> [260.374720] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.374726] process_one_work+0x239/0x760
<4> [260.374733] worker_thread+0x200/0x3f0
<4> [260.374736] ? __pfx_worker_thread+0x10/0x10
<4> [260.374738] kthread+0x10d/0x150
<4> [260.374742] ? __pfx_kthread+0x10/0x10
<4> [260.374746] ret_from_fork+0x3d4/0x480
<4> [260.374748] ? __pfx_kthread+0x10/0x10
<4> [260.374751] ret_from_fork_asm+0x1a/0x30
<4> [260.374759] </TASK>
<4> [260.374760] irq event stamp: 375533
<4> [260.374762] hardirqs last enabled at (375539): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.374765] hardirqs last disabled at (375544): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.374767] softirqs last enabled at (374478): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.374770] softirqs last disabled at (374471): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.374772] ---[ end trace 0000000000000000 ]---
<7> [260.375837] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [260.375976] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [260.376228] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73752, lrc_seqno=73752, guc_id=0, flags=0x73 in no process [-1]
<7> [260.376233] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.376297] ------------[ cut here ]------------
<4> [260.376298] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.376300] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:218/7009
<4> [260.376372] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.376437] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.376442] CPU: 5 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.376445] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.376446] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.376447] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.376453] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.376540] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.376542] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [260.376544] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.376546] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.376547] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.376548] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.376550] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.376551] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000
<4> [260.376553] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.376554] CR2: 000072daabb91008 CR3: 000000000344c005 CR4: 0000000000f72ef0
<4> [260.376556] PKRU: 55555554
<4> [260.376557] Call Trace:
<4> [260.376558] <TASK>
<4> [260.376563] ? lock_acquire+0x20/0x2f0
<4> [260.376568] ? lock_release+0xd0/0x2b0
<4> [260.376574] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.376579] process_one_work+0x239/0x760
<4> [260.376585] worker_thread+0x200/0x3f0
<4> [260.376588] ? __pfx_worker_thread+0x10/0x10
<4> [260.376591] kthread+0x10d/0x150
<4> [260.376594] ? __pfx_kthread+0x10/0x10
<4> [260.376597] ret_from_fork+0x3d4/0x480
<4> [260.376600] ? __pfx_kthread+0x10/0x10
<4> [260.376603] ret_from_fork_asm+0x1a/0x30
<4> [260.376610] </TASK>
<4> [260.376612] irq event stamp: 378667
<4> [260.376613] hardirqs last enabled at (378673): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.376616] hardirqs last disabled at (378678): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.376618] softirqs last enabled at (378506): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.376621] softirqs last disabled at (378501): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.376623] ---[ end trace 0000000000000000 ]---
<6> [260.376625] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [260.376694] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [260.376701] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [260.376929] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [260.377127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [260.377206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [260.377285] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [260.377360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [260.377434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [260.377519] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [260.377598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [260.377672] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [260.377741] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [260.377824] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [260.377927] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [260.378923] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [260.389466] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [260.389709] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [260.391170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [260.391246] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [260.391317] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [260.391388] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [260.391462] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [260.391534] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [260.391602] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [260.391670] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [260.391738] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [260.391806] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [260.391874] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [260.391944] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [260.392011] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [260.392081] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [260.392148] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [260.392215] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [260.392282] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [260.392349] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [260.392419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [260.392508] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [260.392586] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [260.392657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [260.392731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [260.392800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [260.392868] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [260.392937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [260.393004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [260.393076] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [260.393148] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [260.393217] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [260.393287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [260.393358] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [260.393436] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [260.393549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [260.393625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [260.393698] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [260.393769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [260.393839] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [260.393909] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [260.393978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [260.394049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [260.394118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [260.394187] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [260.394256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [260.394331] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [260.394402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [260.394478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [260.394546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [260.394616] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [260.394687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [260.394756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [260.394829] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [260.394896] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [260.394965] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [260.395032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [260.395103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [260.395171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [260.395240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [260.395313] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [260.395423] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [260.395427] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73752, lrc_seqno=73752, guc_id=0, flags=0x73 in no process [-1]
<7> [260.395429] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.395501] ------------[ cut here ]------------
<4> [260.395502] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.395504] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:221/7012
<4> [260.395574] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.395639] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.395644] CPU: 7 UID: 0 PID: 7012 Comm: kworker/u64:221 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.395647] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.395648] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.395649] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.395654] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.395722] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.395724] RSP: 0018:ffffc9000752fca0 EFLAGS: 00010246
<4> [260.395726] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.395728] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.395729] RBP: ffffc9000752fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.395730] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.395731] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.395733] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000
<4> [260.395734] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.395736] CR2: 000056224d4c49c8 CR3: 000000000344c005 CR4: 0000000000f72ef0
<4> [260.395737] PKRU: 55555554
<4> [260.395738] Call Trace:
<4> [260.395739] <TASK>
<4> [260.395743] ? lock_acquire+0x20/0x2f0
<4> [260.395749] ? lock_release+0xd0/0x2b0
<4> [260.395754] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.395759] process_one_work+0x239/0x760
<4> [260.395766] worker_thread+0x200/0x3f0
<4> [260.395768] ? __pfx_worker_thread+0x10/0x10
<4> [260.395771] kthread+0x10d/0x150
<4> [260.395774] ? __pfx_kthread+0x10/0x10
<4> [260.395777] ret_from_fork+0x3d4/0x480
<4> [260.395779] ? __pfx_kthread+0x10/0x10
<4> [260.395782] ret_from_fork_asm+0x1a/0x30
<4> [260.395790] </TASK>
<4> [260.395791] irq event stamp: 264977
<4> [260.395792] hardirqs last enabled at (264983): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.395795] hardirqs last disabled at (264988): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.395797] softirqs last enabled at (264050): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.395799] softirqs last disabled at (264043): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.395801] ---[ end trace 0000000000000000 ]---
<6> [260.395803] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [260.395870] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [260.395876] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [260.396283] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [260.396486] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [260.396572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [260.396658] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [260.396737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [260.396814] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [260.396891] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [260.396970] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [260.397051] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [260.397124] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [260.397215] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [260.397327] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [260.398330] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [260.409048] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [260.409286] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [260.410458] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [260.410532] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [260.410603] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [260.410674] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [260.410745] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [260.410816] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [260.410885] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [260.410954] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [260.411022] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [260.411090] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [260.411159] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [260.411227] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [260.411294] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [260.411362] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [260.411430] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [260.411508] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [260.411576] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [260.411644] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [260.411711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [260.411789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [260.411865] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [260.411937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [260.412011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [260.412083] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [260.412153] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [260.412221] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [260.412290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [260.412363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [260.412434] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [260.412514] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [260.412585] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [260.412657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [260.412735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [260.412811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [260.412889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [260.412960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [260.413031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [260.413102] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [260.413173] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [260.413242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [260.413315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [260.413385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [260.413454] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [260.413538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [260.413612] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [260.413681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [260.413751] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [260.413819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [260.413889] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [260.413957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [260.414025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [260.414095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [260.414164] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [260.414232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [260.414298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [260.414369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [260.414437] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [260.414517] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [260.414588] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [260.414696] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [260.414700] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73752, lrc_seqno=73752, guc_id=0, flags=0x73 in no process [-1]
<7> [260.414702] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.414760] ------------[ cut here ]------------
<4> [260.414761] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.414762] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:221/7012
<4> [260.414830] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.414893] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.414898] CPU: 7 UID: 0 PID: 7012 Comm: kworker/u64:221 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.414901] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.414902] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.414903] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.414908] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.414974] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.414975] RSP: 0018:ffffc9000752fca0 EFLAGS: 00010246
<4> [260.414977] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.414979] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.414980] RBP: ffffc9000752fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.414981] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.414982] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.414984] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000
<4> [260.414985] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.414987] CR2: 000056224d4c49c8 CR3: 000000000344c005 CR4: 0000000000f72ef0
<4> [260.414988] PKRU: 55555554
<4> [260.414989] Call Trace:
<4> [260.414990] <TASK>
<4> [260.414994] ? lock_acquire+0x20/0x2f0
<4> [260.415000] ? lock_release+0xd0/0x2b0
<4> [260.415005] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.415010] process_one_work+0x239/0x760
<4> [260.415016] worker_thread+0x200/0x3f0
<4> [260.415019] ? __pfx_worker_thread+0x10/0x10
<4> [260.415021] kthread+0x10d/0x150
<4> [260.415024] ? __pfx_kthread+0x10/0x10
<4> [260.415028] ret_from_fork+0x3d4/0x480
<4> [260.415030] ? __pfx_kthread+0x10/0x10
<4> [260.415033] ret_from_fork_asm+0x1a/0x30
<4> [260.415040] </TASK>
<4> [260.415042] irq event stamp: 268085
<4> [260.415043] hardirqs last enabled at (268091): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.415045] hardirqs last disabled at (268096): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.415048] softirqs last enabled at (267022): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.415050] softirqs last disabled at (267015): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.415052] ---[ end trace 0000000000000000 ]---
<5> [260.416256] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73807, lrc_seqno=73807, guc_id=0, flags=0x73 in no process [-1]
<7> [260.416259] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.416319] ------------[ cut here ]------------
<4> [260.416320] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.416322] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:221/7012
<4> [260.416386] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.416450] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.416457] CPU: 7 UID: 0 PID: 7012 Comm: kworker/u64:221 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.416460] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.416461] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.416463] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.416468] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.416533] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.416535] RSP: 0018:ffffc9000752fca0 EFLAGS: 00010246
<4> [260.416537] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.416538] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.416539] RBP: ffffc9000752fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.416541] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.416542] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.416543] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000
<4> [260.416545] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.416546] CR2: 000056224d4c49c8 CR3: 000000000344c005 CR4: 0000000000f72ef0
<4> [260.416547] PKRU: 55555554
<4> [260.416548] Call Trace:
<4> [260.416549] <TASK>
<4> [260.416553] ? lock_acquire+0x20/0x2f0
<4> [260.416558] ? lock_release+0xd0/0x2b0
<4> [260.416563] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.416569] process_one_work+0x239/0x760
<4> [260.416575] worker_thread+0x200/0x3f0
<4> [260.416578] ? __pfx_worker_thread+0x10/0x10
<4> [260.416580] kthread+0x10d/0x150
<4> [260.416583] ? __pfx_kthread+0x10/0x10
<4> [260.416586] ret_from_fork+0x3d4/0x480
<4> [260.416588] ? __pfx_kthread+0x10/0x10
<4> [260.416592] ret_from_fork_asm+0x1a/0x30
<4> [260.416599] </TASK>
<4> [260.416600] irq event stamp: 270129
<4> [260.416601] hardirqs last enabled at (270135): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.416604] hardirqs last disabled at (270140): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.416606] softirqs last enabled at (267022): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.416608] softirqs last disabled at (267015): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.416610] ---[ end trace 0000000000000000 ]---
<7> [260.416622] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [260.416719] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<6> [260.416811] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [260.416880] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [260.416886] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [260.416936] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [260.417144] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [260.417234] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [260.417322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [260.417404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [260.417496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [260.417577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [260.417655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [260.417735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [260.417811] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [260.417904] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [260.418015] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [260.419021] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [260.429463] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [260.429713] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [260.430680] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [260.430755] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [260.430827] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [260.430897] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [260.430966] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [260.431034] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [260.431104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [260.431170] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [260.431238] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [260.431304] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [260.431370] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [260.431438] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [260.431519] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [260.431586] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [260.431654] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [260.431722] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [260.431790] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [260.431858] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [260.431926] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [260.432003] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [260.432078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [260.432151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [260.432223] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [260.432293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [260.432363] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [260.432433] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [260.432511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [260.432582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [260.432655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [260.432726] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [260.432797] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [260.432869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [260.432947] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [260.433022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [260.433097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [260.433170] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [260.433243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [260.433312] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [260.433382] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [260.433452] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [260.433577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [260.433649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [260.433718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [260.433786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [260.433860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [260.433930] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [260.434000] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [260.434068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [260.434139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [260.434208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [260.434277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [260.434348] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [260.434418] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [260.434496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [260.434565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [260.434634] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [260.434701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [260.434772] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [260.434848] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [260.434958] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [260.434962] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73807, lrc_seqno=73807, guc_id=0, flags=0x73 in no process [-1]
<7> [260.434964] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.435023] ------------[ cut here ]------------
<4> [260.435024] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.435025] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:218/7009
<4> [260.435094] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.435159] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.435164] CPU: 5 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.435167] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.435168] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.435170] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.435175] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.435242] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.435243] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [260.435246] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.435247] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.435248] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.435250] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.435251] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.435252] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000
<4> [260.435254] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.435255] CR2: 000072daabb91008 CR3: 000000000344c005 CR4: 0000000000f72ef0
<4> [260.435257] PKRU: 55555554
<4> [260.435258] Call Trace:
<4> [260.435259] <TASK>
<4> [260.435263] ? lock_acquire+0x20/0x2f0
<4> [260.435269] ? lock_release+0xd0/0x2b0
<4> [260.435274] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.435280] process_one_work+0x239/0x760
<4> [260.435286] worker_thread+0x200/0x3f0
<4> [260.435289] ? __pfx_worker_thread+0x10/0x10
<4> [260.435291] kthread+0x10d/0x150
<4> [260.435294] ? __pfx_kthread+0x10/0x10
<4> [260.435297] ret_from_fork+0x3d4/0x480
<4> [260.435299] ? __pfx_kthread+0x10/0x10
<4> [260.435303] ret_from_fork_asm+0x1a/0x30
<4> [260.435310] </TASK>
<4> [260.435311] irq event stamp: 384233
<4> [260.435312] hardirqs last enabled at (384239): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.435315] hardirqs last disabled at (384244): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.435317] softirqs last enabled at (383354): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.435320] softirqs last disabled at (383347): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.435322] ---[ end trace 0000000000000000 ]---
<6> [260.435324] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [260.435389] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [260.435395] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [260.436629] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [260.436729] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [260.436829] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [260.437037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [260.437127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [260.437215] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [260.437298] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [260.437378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [260.437464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [260.437542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [260.437621] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [260.437698] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [260.437789] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [260.437902] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [260.438908] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [260.449460] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [260.449708] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [260.450729] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [260.450804] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [260.450875] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [260.450947] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [260.451018] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [260.451087] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [260.451158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [260.451229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [260.451300] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [260.451372] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [260.451442] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [260.451528] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [260.451598] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [260.451666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [260.451733] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [260.451801] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [260.451869] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [260.451936] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [260.452004] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [260.452080] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [260.452156] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [260.452228] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [260.452300] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [260.452371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [260.452441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [260.452524] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [260.452595] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [260.452668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [260.452742] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [260.452813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [260.452885] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [260.452956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [260.453031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [260.453107] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [260.453183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [260.453258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [260.453329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [260.453398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [260.453471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [260.453538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [260.453610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [260.453680] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [260.453749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [260.453817] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [260.453888] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [260.453957] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [260.454025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [260.454091] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [260.454160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [260.454229] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [260.454299] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [260.454373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [260.454444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [260.454528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [260.454600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [260.454671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [260.454739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [260.454809] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [260.454882] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [260.454993] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [260.454997] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73807, lrc_seqno=73807, guc_id=0, flags=0x73 in no process [-1]
<7> [260.454999] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.455057] ------------[ cut here ]------------
<4> [260.455058] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.455060] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:220/7011
<4> [260.455129] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.455194] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.455199] CPU: 11 UID: 0 PID: 7011 Comm: kworker/u64:220 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.455202] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.455203] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.455204] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.455210] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.455276] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.455278] RSP: 0018:ffffc90007527ca0 EFLAGS: 00010246
<4> [260.455280] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.455281] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.455283] RBP: ffffc90007527db0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.455284] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.455285] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.455286] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [260.455288] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.455289] CR2: 000070a320be61b4 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [260.455291] PKRU: 55555554
<4> [260.455292] Call Trace:
<4> [260.455293] <TASK>
<4> [260.455297] ? lock_acquire+0x20/0x2f0
<4> [260.455303] ? lock_release+0xd0/0x2b0
<4> [260.455308] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.455314] process_one_work+0x239/0x760
<4> [260.455320] worker_thread+0x200/0x3f0
<4> [260.455323] ? __pfx_worker_thread+0x10/0x10
<4> [260.455325] kthread+0x10d/0x150
<4> [260.455328] ? __pfx_kthread+0x10/0x10
<4> [260.455331] ret_from_fork+0x3d4/0x480
<4> [260.455333] ? __pfx_kthread+0x10/0x10
<4> [260.455337] ret_from_fork_asm+0x1a/0x30
<4> [260.455344] </TASK>
<4> [260.455345] irq event stamp: 496855
<4> [260.455346] hardirqs last enabled at (496861): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.455349] hardirqs last disabled at (496866): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.455351] softirqs last enabled at (495872): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.455354] softirqs last disabled at (495867): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.455356] ---[ end trace 0000000000000000 ]---
<5> [260.456847] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73862, lrc_seqno=73862, guc_id=0, flags=0x73 in no process [-1]
<7> [260.456850] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.456909] ------------[ cut here ]------------
<4> [260.456910] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.456911] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:220/7011
<4> [260.456997] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.457061] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.457066] CPU: 11 UID: 0 PID: 7011 Comm: kworker/u64:220 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.457068] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.457070] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.457071] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.457076] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.457141] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.457142] RSP: 0018:ffffc90007527ca0 EFLAGS: 00010246
<4> [260.457144] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.457146] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.457147] RBP: ffffc90007527db0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.457148] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.457149] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.457151] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [260.457152] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.457154] CR2: 000070a320be61b4 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [260.457155] PKRU: 55555554
<4> [260.457156] Call Trace:
<4> [260.457157] <TASK>
<4> [260.457161] ? lock_acquire+0x20/0x2f0
<4> [260.457166] ? lock_release+0xd0/0x2b0
<4> [260.457171] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.457177] process_one_work+0x239/0x760
<4> [260.457183] worker_thread+0x200/0x3f0
<4> [260.457185] ? __pfx_worker_thread+0x10/0x10
<4> [260.457188] kthread+0x10d/0x150
<4> [260.457190] ? __pfx_kthread+0x10/0x10
<4> [260.457194] ret_from_fork+0x3d4/0x480
<4> [260.457196] ? __pfx_kthread+0x10/0x10
<4> [260.457199] ret_from_fork_asm+0x1a/0x30
<4> [260.457207] </TASK>
<4> [260.457208] irq event stamp: 499497
<4> [260.457209] hardirqs last enabled at (499503): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.457211] hardirqs last disabled at (499508): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.457214] softirqs last enabled at (495872): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.457216] softirqs last disabled at (495867): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.457218] ---[ end trace 0000000000000000 ]---
<6> [260.457220] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [260.457286] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [260.457292] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [260.457518] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [260.457616] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [260.457715] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [260.457916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [260.458001] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [260.458086] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [260.458167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [260.458246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [260.458324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [260.458402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [260.458491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [260.458569] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [260.458659] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [260.458771] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [260.459776] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [260.470458] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [260.470704] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [260.471700] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [260.471774] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [260.471846] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [260.471919] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [260.471990] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [260.472059] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [260.472129] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [260.472197] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [260.472265] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [260.472334] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [260.472401] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [260.472474] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [260.472543] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [260.472612] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [260.472678] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [260.472745] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [260.472813] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [260.472881] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [260.472949] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [260.473025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [260.473099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [260.473171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [260.473244] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [260.473315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [260.473385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [260.473458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [260.473527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [260.473598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [260.473670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [260.473739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [260.473810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [260.473881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [260.473956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [260.474032] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [260.474108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [260.474180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [260.474251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [260.474320] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [260.474392] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [260.474464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [260.474536] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [260.474605] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [260.474674] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [260.474740] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [260.474811] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [260.474878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [260.474946] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [260.475014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [260.475082] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [260.475150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [260.475216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [260.475287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [260.475356] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [260.475425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [260.475501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [260.475572] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [260.475639] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [260.475706] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [260.475778] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [260.475887] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [260.475891] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73862, lrc_seqno=73862, guc_id=0, flags=0x73 in no process [-1]
<7> [260.475893] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.475949] ------------[ cut here ]------------
<4> [260.475950] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.475952] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:220/7011
<4> [260.476021] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.476085] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.476089] CPU: 11 UID: 0 PID: 7011 Comm: kworker/u64:220 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.476092] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.476093] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.476094] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.476099] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.476164] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.476166] RSP: 0018:ffffc90007527ca0 EFLAGS: 00010246
<4> [260.476168] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.476169] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.476171] RBP: ffffc90007527db0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.476172] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.476173] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.476174] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [260.476176] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.476177] CR2: 000070a320be61b4 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [260.476179] PKRU: 55555554
<4> [260.476180] Call Trace:
<4> [260.476181] <TASK>
<4> [260.476185] ? lock_acquire+0x20/0x2f0
<4> [260.476190] ? lock_release+0xd0/0x2b0
<4> [260.476195] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.476201] process_one_work+0x239/0x760
<4> [260.476207] worker_thread+0x200/0x3f0
<4> [260.476209] ? __pfx_worker_thread+0x10/0x10
<4> [260.476212] kthread+0x10d/0x150
<4> [260.476215] ? __pfx_kthread+0x10/0x10
<4> [260.476218] ret_from_fork+0x3d4/0x480
<4> [260.476220] ? __pfx_kthread+0x10/0x10
<4> [260.476223] ret_from_fork_asm+0x1a/0x30
<4> [260.476231] </TASK>
<4> [260.476232] irq event stamp: 502587
<4> [260.476233] hardirqs last enabled at (502593): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.476235] hardirqs last disabled at (502598): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.476238] softirqs last enabled at (501394): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.476240] softirqs last disabled at (501389): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.476242] ---[ end trace 0000000000000000 ]---
<6> [260.476244] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [260.476309] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [260.476314] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [260.477372] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [260.477475] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [260.477574] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [260.477775] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [260.477856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [260.477940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [260.478022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [260.478101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [260.478178] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [260.478255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [260.478333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [260.478406] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [260.478503] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [260.478612] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [260.479613] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [260.489455] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [260.489700] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [260.490710] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [260.490784] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [260.490853] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [260.490924] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [260.490993] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [260.491063] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [260.491132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [260.491202] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [260.491273] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [260.491343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [260.491412] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [260.491489] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [260.491557] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [260.491624] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [260.491692] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [260.491759] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [260.491827] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [260.491894] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [260.491962] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [260.492037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [260.492111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [260.492184] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [260.492258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [260.492329] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [260.492398] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [260.492472] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [260.492542] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [260.492613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [260.492684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [260.492755] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [260.492828] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [260.492900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [260.492978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [260.493055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [260.493131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [260.493203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [260.493275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [260.493345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [260.493413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [260.493491] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [260.493563] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [260.493633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [260.493701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [260.493768] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [260.493840] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [260.493907] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [260.493977] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [260.494045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [260.494113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [260.494179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [260.494246] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [260.494318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [260.494388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [260.494458] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [260.494529] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [260.494602] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [260.494671] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [260.494739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [260.494810] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [260.494918] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [260.494922] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73862, lrc_seqno=73862, guc_id=0, flags=0x73 in no process [-1]
<7> [260.494925] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.494981] ------------[ cut here ]------------
<4> [260.494982] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.494983] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:220/7011
<4> [260.495051] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.495115] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.495120] CPU: 11 UID: 0 PID: 7011 Comm: kworker/u64:220 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.495123] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.495124] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.495125] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.495130] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.495197] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.495199] RSP: 0018:ffffc90007527ca0 EFLAGS: 00010246
<4> [260.495201] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.495203] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.495204] RBP: ffffc90007527db0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.495205] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.495206] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.495208] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [260.495209] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.495211] CR2: 000070a320be61b4 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [260.495212] PKRU: 55555554
<4> [260.495213] Call Trace:
<4> [260.495214] <TASK>
<4> [260.495218] ? lock_acquire+0x20/0x2f0
<4> [260.495223] ? lock_release+0xd0/0x2b0
<4> [260.495229] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.495234] process_one_work+0x239/0x760
<4> [260.495240] worker_thread+0x200/0x3f0
<4> [260.495243] ? __pfx_worker_thread+0x10/0x10
<4> [260.495245] kthread+0x10d/0x150
<4> [260.495248] ? __pfx_kthread+0x10/0x10
<4> [260.495252] ret_from_fork+0x3d4/0x480
<4> [260.495254] ? __pfx_kthread+0x10/0x10
<4> [260.495257] ret_from_fork_asm+0x1a/0x30
<4> [260.495264] </TASK>
<4> [260.495266] irq event stamp: 505673
<4> [260.495267] hardirqs last enabled at (505679): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.495269] hardirqs last disabled at (505684): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.495272] softirqs last enabled at (504584): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.495274] softirqs last disabled at (504579): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.495276] ---[ end trace 0000000000000000 ]---
<5> [260.496663] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73917, lrc_seqno=73917, guc_id=0, flags=0x73 in no process [-1]
<7> [260.496666] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.496726] ------------[ cut here ]------------
<4> [260.496727] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.496728] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:220/7011
<4> [260.496813] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.496877] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.496881] CPU: 11 UID: 0 PID: 7011 Comm: kworker/u64:220 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.496884] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.496885] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.496886] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.496891] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.496955] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.496956] RSP: 0018:ffffc90007527ca0 EFLAGS: 00010246
<4> [260.496958] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.496959] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.496961] RBP: ffffc90007527db0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.496962] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.496963] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.496964] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [260.496966] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.496967] CR2: 000070a320be61b4 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [260.496968] PKRU: 55555554
<4> [260.496970] Call Trace:
<4> [260.496971] <TASK>
<4> [260.496974] ? lock_acquire+0x20/0x2f0
<4> [260.496979] ? lock_release+0xd0/0x2b0
<4> [260.496984] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.496990] process_one_work+0x239/0x760
<4> [260.496996] worker_thread+0x200/0x3f0
<4> [260.496999] ? __pfx_worker_thread+0x10/0x10
<4> [260.497001] kthread+0x10d/0x150
<4> [260.497004] ? __pfx_kthread+0x10/0x10
<4> [260.497007] ret_from_fork+0x3d4/0x480
<4> [260.497009] ? __pfx_kthread+0x10/0x10
<4> [260.497012] ret_from_fork_asm+0x1a/0x30
<4> [260.497020] </TASK>
<4> [260.497021] irq event stamp: 508399
<4> [260.497022] hardirqs last enabled at (508405): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.497025] hardirqs last disabled at (508410): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.497027] softirqs last enabled at (504584): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.497029] softirqs last disabled at (504579): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.497031] ---[ end trace 0000000000000000 ]---
<6> [260.497033] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [260.497096] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [260.497101] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [260.497307] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [260.497406] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [260.497517] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [260.497720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [260.497803] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [260.497890] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [260.497968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [260.498046] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [260.498123] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [260.498202] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [260.498281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [260.498355] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [260.498444] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [260.498568] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [260.499570] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [260.509453] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [260.509699] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [260.510721] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [260.510795] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [260.510866] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [260.510936] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [260.511006] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [260.511074] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [260.511141] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [260.511209] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [260.511277] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [260.511344] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [260.511410] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [260.511490] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [260.511558] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [260.511625] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [260.511692] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [260.511759] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [260.511825] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [260.511891] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [260.511958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [260.512033] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [260.512108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [260.512179] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [260.512250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [260.512318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [260.512386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [260.512457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [260.512528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [260.512600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [260.512670] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [260.512739] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [260.512808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [260.512876] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [260.512951] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [260.513024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [260.513100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [260.513171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [260.513242] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [260.513309] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [260.513379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [260.513444] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [260.513531] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [260.513603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [260.513673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [260.513743] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [260.513815] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [260.513883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [260.513950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [260.514016] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [260.514085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [260.514151] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [260.514218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [260.514289] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [260.514359] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [260.514425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [260.514501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [260.514569] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [260.514635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [260.514701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [260.514769] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [260.514876] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [260.514880] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73917, lrc_seqno=73917, guc_id=0, flags=0x73 in no process [-1]
<7> [260.514883] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.514939] ------------[ cut here ]------------
<4> [260.514940] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.514941] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:220/7011
<4> [260.515009] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.515073] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.515078] CPU: 11 UID: 0 PID: 7011 Comm: kworker/u64:220 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.515080] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.515082] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.515083] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.515088] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.515153] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.515155] RSP: 0018:ffffc90007527ca0 EFLAGS: 00010246
<4> [260.515157] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.515158] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.515159] RBP: ffffc90007527db0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.515161] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.515162] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.515163] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [260.515165] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.515166] CR2: 000070a320be61b4 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [260.515167] PKRU: 55555554
<4> [260.515169] Call Trace:
<4> [260.515170] <TASK>
<4> [260.515174] ? lock_acquire+0x20/0x2f0
<4> [260.515179] ? lock_release+0xd0/0x2b0
<4> [260.515184] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.515190] process_one_work+0x239/0x760
<4> [260.515196] worker_thread+0x200/0x3f0
<4> [260.515199] ? __pfx_worker_thread+0x10/0x10
<4> [260.515201] kthread+0x10d/0x150
<4> [260.515204] ? __pfx_kthread+0x10/0x10
<4> [260.515207] ret_from_fork+0x3d4/0x480
<4> [260.515209] ? __pfx_kthread+0x10/0x10
<4> [260.515212] ret_from_fork_asm+0x1a/0x30
<4> [260.515220] </TASK>
<4> [260.515221] irq event stamp: 511501
<4> [260.515222] hardirqs last enabled at (511507): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.515225] hardirqs last disabled at (511512): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.515227] softirqs last enabled at (510412): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.515229] softirqs last disabled at (510403): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.515232] ---[ end trace 0000000000000000 ]---
<6> [260.515233] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [260.515299] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [260.515304] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [260.516536] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [260.516637] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [260.516738] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [260.516942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [260.517030] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [260.517120] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [260.517203] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [260.517282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [260.517361] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [260.517440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [260.517535] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [260.517613] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [260.517705] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [260.517817] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [260.518824] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [260.529450] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [260.529707] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [260.530663] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [260.530738] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [260.530810] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [260.530882] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [260.530952] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [260.531022] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [260.531091] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [260.531158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [260.531226] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [260.531294] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [260.531363] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [260.531429] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [260.531514] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [260.531580] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [260.531646] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [260.531713] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [260.531780] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [260.531847] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [260.531915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [260.531992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [260.532068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [260.532140] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [260.532212] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [260.532282] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [260.532353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [260.532423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [260.532502] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [260.532574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [260.532647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [260.532718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [260.532789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [260.532861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [260.532938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [260.533014] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [260.533092] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [260.533167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [260.533239] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [260.533307] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [260.533377] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [260.533448] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [260.533520] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [260.533589] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [260.533657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [260.533723] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [260.533793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [260.533862] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [260.533929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [260.533998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [260.534068] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [260.534136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [260.534210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [260.534280] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [260.534349] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [260.534417] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [260.534495] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [260.534568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [260.534637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [260.534703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [260.534773] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [260.534881] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [260.534885] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73917, lrc_seqno=73917, guc_id=0, flags=0x73 in no process [-1]
<7> [260.534887] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.534944] ------------[ cut here ]------------
<4> [260.534945] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.534947] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:218/7009
<4> [260.535014] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.535079] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.535084] CPU: 5 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.535087] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.535088] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.535089] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.535094] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.535159] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.535161] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [260.535163] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.535165] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.535166] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.535167] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.535169] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.535170] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000
<4> [260.535172] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.535173] CR2: 000072daabb91008 CR3: 000000000344c005 CR4: 0000000000f72ef0
<4> [260.535174] PKRU: 55555554
<4> [260.535176] Call Trace:
<4> [260.535177] <TASK>
<4> [260.535181] ? lock_acquire+0x20/0x2f0
<4> [260.535186] ? lock_release+0xd0/0x2b0
<4> [260.535191] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.535197] process_one_work+0x239/0x760
<4> [260.535203] worker_thread+0x200/0x3f0
<4> [260.535206] ? __pfx_worker_thread+0x10/0x10
<4> [260.535208] kthread+0x10d/0x150
<4> [260.535211] ? __pfx_kthread+0x10/0x10
<4> [260.535215] ret_from_fork+0x3d4/0x480
<4> [260.535217] ? __pfx_kthread+0x10/0x10
<4> [260.535220] ret_from_fork_asm+0x1a/0x30
<4> [260.535227] </TASK>
<4> [260.535229] irq event stamp: 392563
<4> [260.535230] hardirqs last enabled at (392569): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.535232] hardirqs last disabled at (392574): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.535235] softirqs last enabled at (391378): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.535237] softirqs last disabled at (391373): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.535239] ---[ end trace 0000000000000000 ]---
<5> [260.535823] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73972, lrc_seqno=73972, guc_id=0, flags=0x73 in no process [-1]
<7> [260.535826] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.535882] ------------[ cut here ]------------
<4> [260.535883] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.535885] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:218/7009
<4> [260.535951] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.536015] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.536019] CPU: 5 UID: 0 PID: 7009 Comm: kworker/u64:218 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.536022] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.536023] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.536024] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.536029] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.536094] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.536096] RSP: 0018:ffffc9000230fca0 EFLAGS: 00010246
<4> [260.536098] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.536099] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.536100] RBP: ffffc9000230fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.536101] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.536103] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.536104] FS: 0000000000000000(0000) GS:ffff8888daf17000(0000) knlGS:0000000000000000
<4> [260.536105] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.536107] CR2: 000072daabb91008 CR3: 000000000344c005 CR4: 0000000000f72ef0
<4> [260.536108] PKRU: 55555554
<4> [260.536109] Call Trace:
<4> [260.536110] <TASK>
<4> [260.536114] ? lock_acquire+0x20/0x2f0
<4> [260.536119] ? lock_release+0xd0/0x2b0
<4> [260.536124] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.536129] process_one_work+0x239/0x760
<4> [260.536135] worker_thread+0x200/0x3f0
<4> [260.536138] ? __pfx_worker_thread+0x10/0x10
<4> [260.536140] kthread+0x10d/0x150
<4> [260.536143] ? __pfx_kthread+0x10/0x10
<4> [260.536147] ret_from_fork+0x3d4/0x480
<4> [260.536149] ? __pfx_kthread+0x10/0x10
<4> [260.536152] ret_from_fork_asm+0x1a/0x30
<4> [260.536159] </TASK>
<4> [260.536160] irq event stamp: 395251
<4> [260.536162] hardirqs last enabled at (395257): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.536164] hardirqs last disabled at (395262): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.536166] softirqs last enabled at (391378): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.536168] softirqs last disabled at (391373): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.536171] ---[ end trace 0000000000000000 ]---
<6> [260.536172] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [260.536238] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [260.536243] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [260.537297] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [260.537399] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [260.537513] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [260.537715] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [260.537795] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [260.537878] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [260.537958] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [260.538036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [260.538113] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [260.538190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [260.538266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [260.538338] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [260.538429] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [260.538548] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [260.539552] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [260.549450] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [260.549696] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [260.550724] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [260.550798] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [260.550870] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [260.550943] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [260.551013] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [260.551082] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [260.551152] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [260.551220] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [260.551290] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [260.551358] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [260.551428] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [260.551537] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [260.551608] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [260.551675] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [260.551741] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [260.551810] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [260.551880] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [260.551948] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [260.552018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [260.552095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [260.552171] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [260.552243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [260.552316] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [260.552385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [260.552457] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [260.552527] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [260.552598] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [260.552673] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [260.552749] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [260.552820] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [260.552892] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [260.552964] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [260.553040] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [260.553115] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [260.553190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [260.553262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [260.553333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [260.553406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [260.553488] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [260.553556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [260.553627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [260.553696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [260.553765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [260.553833] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [260.553906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [260.553975] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [260.554043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [260.554110] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [260.554180] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [260.554249] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [260.554318] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [260.554389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [260.554461] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [260.554532] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [260.554600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [260.554669] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [260.554741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [260.554812] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [260.554886] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [260.554995] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [260.554999] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=73972, lrc_seqno=73972, guc_id=0, flags=0x73 in no process [-1]
<7> [260.555001] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [260.555058] ------------[ cut here ]------------
<4> [260.555059] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [260.555060] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#11: kworker/u64:220/7011
<4> [260.555130] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp coretemp hid_generic cmdlinepart mei_pxp spi_nor asus_nb_wmi mei_hdcp asus_wmi mtd sparse_keymap platform_profile wmi_bmof kvm_intel binfmt_misc usbhid kvm hid irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel snd_hda_codec snd_hda_core rapl snd_hwdep video r8169 snd_pcm intel_cstate realtek snd_timer i2c_i801 i2c_mux idma64 snd mei_me soundcore i2c_smbus spi_intel_pci spi_intel mei nls_iso8859_1 intel_pmc_core pmt_telemetry pmt_discovery pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake intel_vsec acpi_tad wmi acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.555195] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.555200] CPU: 11 UID: 0 PID: 7011 Comm: kworker/u64:220 Tainted: G S U W 7.0.0-rc6-lgci-xe-xe-4844-76f07a8a9c7616869-debug+ #1 PREEMPT(lazy)
<4> [260.555203] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [260.555204] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1645 03/15/2024
<4> [260.555205] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.555210] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [260.555276] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 a3 5e e1 48 89 c6 48 8d 3d dc 98 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [260.555277] RSP: 0018:ffffc90007527ca0 EFLAGS: 00010246
<4> [260.555280] RAX: ffffffffa1202e29 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.555281] RDX: ffff888103fd1610 RSI: ffffffffa1202e29 RDI: ffffffffa1003ed0
<4> [260.555282] RBP: ffffc90007527db0 R08: 0000000000000000 R09: 0000000000000000
<4> [260.555283] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [260.555285] R13: ffff888103fd1610 R14: ffff8881ddf26818 R15: 00000000ffffffc2
<4> [260.555286] FS: 0000000000000000(0000) GS:ffff8888db217000(0000) knlGS:0000000000000000
<4> [260.555288] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.555289] CR2: 000070a320be61b4 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [260.555290] PKRU: 55555554
<4> [260.555292] Call Trace:
<4> [260.555293] <TASK>
<4> [260.555297] ? lock_acquire+0x20/0x2f0
<4> [260.555302] ? lock_release+0xd0/0x2b0
<4> [260.555307] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.555313] process_one_work+0x239/0x760
<4> [260.555319] worker_thread+0x200/0x3f0
<4> [260.555322] ? __pfx_worker_thread+0x10/0x10
<4> [260.555324] kthread+0x10d/0x150
<4> [260.555327] ? __pfx_kthread+0x10/0x10
<4> [260.555331] ret_from_fork+0x3d4/0x480
<4> [260.555333] ? __pfx_kthread+0x10/0x10
<4> [260.555336] ret_from_fork_asm+0x1a/0x30
<4> [260.555343] </TASK>
<4> [260.555345] irq event stamp: 517115
<4> [260.555346] hardirqs last enabled at (517121): [<ffffffff814a9ca9>] __up_console_sem+0x79/0xa0
<4> [260.555348] hardirqs last disabled at (517126): [<ffffffff814a9c8e>] __up_console_sem+0x5e/0xa0
<4> [260.555351] softirqs last enabled at (516132): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.555353] softirqs last disabled at (516127): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.555356] ---[ end trace 0000000000000000 ]---
<6> [260.555357] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [260.555422] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [260.555428] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [260.556661] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [260.556761] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [260.556861] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [260.557070] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [260.557160] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [260.557251] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [260.557334] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [260.557413] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [260.557504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
Created at 2026-04-03 12:43:31