Result: 52 Warning(s)
i915_display_info10 igt_runner10 results10.json results10-xe-load.json guc_logs10.tar i915_display_info_post_exec10 boot10 dmesg10
| Detail | Value |
|---|---|
| Duration | unknown |
| Hostname |
shard-bmg-3 |
| Igt-Version |
IGT-Version: 2.4-g2d1f7b290 (x86_64) (Linux: 7.0.0-rc7-lgci-xe-xe-4882-645a9910880f44919-debug+ x86_64) |
| Out |
Using IGT_SRANDOM=1775838264 for randomisation Opened device: /dev/dri/card0 Starting subtest: twice-new-busy Stack trace: #0 ../lib/igt_core.c:2075 __igt_fail_assert() #1 [xe_wait_ufence+0x57] #2 ../tests/intel/xe_exec_system_allocator.c:1757 test_exec() #3 ../tests/intel/xe_exec_system_allocator.c:2547 __igt_unique____real_main2349() #4 ../tests/intel/xe_exec_system_allocator.c:2349 main() #5 [__libc_init_first+0x8a] #6 [__libc_start_main+0x8b] #7 [_start+0x25] Subtest twice-new-busy: FAIL (16.648s) This test caused an abort condition: Kernel badly tainted (0x44244, 0x200) (check dmesg for details): TAINT_WARN: WARN_ON has happened. |
| Err |
Starting subtest: twice-new-busy (xe_exec_system_allocator:5169) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:763: (xe_exec_system_allocator:5169) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_exec_system_allocator:5169) xe/xe_ioctl-CRITICAL: Last errno: 62, Timer expired (xe_exec_system_allocator:5169) xe/xe_ioctl-CRITICAL: error: -62 != 0 Subtest twice-new-busy failed. **** DEBUG **** (xe_exec_system_allocator:5169) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:763: (xe_exec_system_allocator:5169) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0 (xe_exec_system_allocator:5169) xe/xe_ioctl-CRITICAL: Last errno: 62, Timer expired (xe_exec_system_allocator:5169) xe/xe_ioctl-CRITICAL: error: -62 != 0 (xe_exec_system_allocator:5169) igt_core-INFO: Stack trace: (xe_exec_system_allocator:5169) igt_core-INFO: #0 ../lib/igt_core.c:2075 __igt_fail_assert() (xe_exec_system_allocator:5169) igt_core-INFO: #1 [xe_wait_ufence+0x57] (xe_exec_system_allocator:5169) igt_core-INFO: #2 ../tests/intel/xe_exec_system_allocator.c:1757 test_exec() (xe_exec_system_allocator:5169) igt_core-INFO: #3 ../tests/intel/xe_exec_system_allocator.c:2547 __igt_unique____real_main2349() (xe_exec_system_allocator:5169) igt_core-INFO: #4 ../tests/intel/xe_exec_system_allocator.c:2349 main() (xe_exec_system_allocator:5169) igt_core-INFO: #5 [__libc_init_first+0x8a] (xe_exec_system_allocator:5169) igt_core-INFO: #6 [__libc_start_main+0x8b] (xe_exec_system_allocator:5169) igt_core-INFO: #7 [_start+0x25] **** END **** Subtest twice-new-busy: FAIL (16.648s) |
| Dmesg |
<6> [255.002177] Console: switching to colour dummy device 80x25
<6> [255.002488] [IGT] xe_exec_system_allocator: executing
<7> [255.025815] xe 0000:03:00.0: [drm:drm_pagemap_dev_unhold_work [drm_gpusvm_helper]] Releasing reference on provider device and module.
<6> [255.026288] [IGT] xe_exec_system_allocator: starting subtest twice-new-busy
<7> [255.030223] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [255.031965] xe 0000:03:00.0: [drm:drm_pagemap_migrate_to_devmem [drm_gpusvm_helper]] Total pages 1; Own pages: 0.
<7> [256.801918] xe 0000:03:00.0: [drm:intel_power_well_enable [xe]] enabling AUX_TC2
<7> [256.905891] xe 0000:03:00.0: [drm:intel_power_well_disable [xe]] disabling AUX_TC2
<4> [260.386895] ------------[ cut here ]------------
<4> [260.386911] xe 0000:03:00.0: [drm] Tile0: GT0: Unexpected engine class:instance 3:8 for context utilization
<4> [260.386923] WARNING: drivers/gpu/drm/xe/xe_lrc.c:2580 at xe_lrc_timestamp+0x196/0x460 [xe], CPU#6: kworker/u64:43/2901
<4> [260.387461] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay binfmt_misc intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart eeepc_wmi spi_nor coretemp asus_wmi sparse_keymap mei_hdcp mtd mei_pxp platform_profile wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel r8169 snd_hda_codec rapl nls_iso8859_1 snd_hda_core usbhid snd_hwdep intel_cstate hid realtek snd_pcm video i2c_i801 snd_timer spi_intel_pci i2c_mux snd spi_intel soundcore i2c_smbus idma64 intel_pmc_core pmt_telemetry mei_me pmt_discovery mei pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi intel_vsec acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [260.387824] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [260.387848] CPU: 6 UID: 0 PID: 2901 Comm: kworker/u64:43 Tainted: G S U L N 7.0.0-rc7-lgci-xe-xe-4882-645a9910880f44919-debug+ #1 PREEMPT(lazy)
<4> [260.387865] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [L]=SOFTLOCKUP, [N]=TEST
<4> [260.387871] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [260.387878] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [260.387907] RIP: 0010:xe_lrc_timestamp+0x1a7/0x460 [xe]
<4> [260.388333] Code: b6 79 26 48 89 55 c8 88 45 d0 e8 e4 eb 5c e1 48 89 c6 48 8d 3d 7a bc 37 00 0f b6 4d d0 41 54 45 89 e9 45 0f b6 c7 48 8b 55 c8 <67> 48 0f b9 3a 58 eb 91 41 0f b6 bd 99 0f 00 00 e8 04 e0 03 00 41
<4> [260.388343] RSP: 0018:ffffc9000423bc00 EFLAGS: 00010246
<4> [260.388355] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000
<4> [260.388363] RDX: ffff888103079410 RSI: ffffffffa1202f13 RDI: ffffffffa1004f40
<4> [260.388369] RBP: ffffc9000423bc90 R08: 0000000000000000 R09: 0000000000000003
<4> [260.388376] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000008
<4> [260.388382] R13: 0000000000000003 R14: ffff888121b6ea80 R15: 0000000000000000
<4> [260.388388] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [260.388397] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [260.388426] CR2: 000079a36473b000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [260.388434] PKRU: 55555554
<4> [260.388440] Call Trace:
<4> [260.388446] <TASK>
<4> [260.388458] ? enable_work+0x9d/0x100
<4> [260.388482] ? xe_lrc_start_seqno+0x33/0x70 [xe]
<4> [260.388898] guc_exec_queue_timedout_job+0xf80/0x2400 [xe]
<4> [260.389295] ? lock_sync+0x100/0x100
<4> [260.389316] ? lock_release+0xd0/0x2b0
<4> [260.389345] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [260.389373] process_one_work+0x239/0x760
<4> [260.389420] worker_thread+0x200/0x3f0
<4> [260.389434] ? __pfx_worker_thread+0x10/0x10
<4> [260.389446] kthread+0x10d/0x150
<4> [260.389462] ? __pfx_kthread+0x10/0x10
<4> [260.389481] ret_from_fork+0x3d4/0x480
<4> [260.389493] ? __pfx_kthread+0x10/0x10
<4> [260.389510] ret_from_fork_asm+0x1a/0x30
<4> [260.389548] </TASK>
<4> [260.389555] irq event stamp: 600557
<4> [260.389562] hardirqs last enabled at (600563): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [260.389578] hardirqs last disabled at (600568): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [260.389590] softirqs last enabled at (599786): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.389603] softirqs last disabled at (599781): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [260.389615] ---[ end trace 0000000000000000 ]---
<7> [260.389628] xe 0000:03:00.0: [drm:guc_exec_queue_timedout_job [xe]] Tile0: GT0: Check job timeout: seqno=36172, lrc_seqno=36172, guc_id=0, running_time_ms=229081, timeout_ms=5000, diff=0xf9adf201
<6> [261.030848] xe 0000:03:00.0: [drm] Tile0: GT0: Engine reset: engine_class=bcs, logical_mask: 0x2, guc_id=0, state=0x209
<5> [261.030986] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=36172, lrc_seqno=36172, guc_id=0, flags=0x73 in no process [-1]
<7> [261.031012] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [261.031460] ------------[ cut here ]------------
<4> [261.031468] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [261.031477] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#6: kworker/u64:43/2901
<4> [261.031890] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay binfmt_misc intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart eeepc_wmi spi_nor coretemp asus_wmi sparse_keymap mei_hdcp mtd mei_pxp platform_profile wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel r8169 snd_hda_codec rapl nls_iso8859_1 snd_hda_core usbhid snd_hwdep intel_cstate hid realtek snd_pcm video i2c_i801 snd_timer spi_intel_pci i2c_mux snd spi_intel soundcore i2c_smbus idma64 intel_pmc_core pmt_telemetry mei_me pmt_discovery mei pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi intel_vsec acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [261.032276] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [261.032302] CPU: 6 UID: 0 PID: 2901 Comm: kworker/u64:43 Tainted: G S U W L N 7.0.0-rc7-lgci-xe-xe-4882-645a9910880f44919-debug+ #1 PREEMPT(lazy)
<4> [261.032320] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP, [N]=TEST
<4> [261.032328] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [261.032336] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [261.032366] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [261.032826] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [261.032836] RSP: 0018:ffffc9000423bca0 EFLAGS: 00010246
<4> [261.032849] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000
<4> [261.032857] RDX: ffff888103079410 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0
<4> [261.032865] RBP: ffffc9000423bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [261.032873] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [261.032879] R13: ffff888103079410 R14: ffff88815a018000 R15: 00000000ffffffc2
<4> [261.032888] FS: 0000000000000000(0000) GS:ffff8888daf97000(0000) knlGS:0000000000000000
<4> [261.032897] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [261.032905] CR2: 000079a36473b000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [261.032914] PKRU: 55555554
<4> [261.032920] Call Trace:
<4> [261.032928] <TASK>
<4> [261.032951] ? lock_sync+0x100/0x100
<4> [261.032978] ? __pfx_autoremove_wake_function+0x10/0x10
<4> [261.033006] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [261.033035] process_one_work+0x239/0x760
<4> [261.033069] worker_thread+0x200/0x3f0
<4> [261.033083] ? __pfx_worker_thread+0x10/0x10
<4> [261.033096] kthread+0x10d/0x150
<4> [261.033113] ? __pfx_kthread+0x10/0x10
<4> [261.033133] ret_from_fork+0x3d4/0x480
<4> [261.033144] ? __pfx_kthread+0x10/0x10
<4> [261.033163] ret_from_fork_asm+0x1a/0x30
<4> [261.033202] </TASK>
<4> [261.033208] irq event stamp: 601405
<4> [261.033214] hardirqs last enabled at (601411): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [261.033231] hardirqs last disabled at (601416): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [261.033242] softirqs last enabled at (600636): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [261.033256] softirqs last disabled at (600631): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [261.033268] ---[ end trace 0000000000000000 ]---
<6> [261.033278] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [261.033705] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [261.034248] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [261.034709] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [261.036553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [261.036645] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [261.036734] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [261.036819] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [261.036902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [261.036984] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [261.037069] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [261.037155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [261.037236] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [261.037327] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [261.037447] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [261.038679] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [261.049455] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [261.049900] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [261.052899] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [261.053153] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [261.053390] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [261.053616] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [261.053834] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [261.054044] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [261.054249] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [261.054476] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [261.054677] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [261.054878] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [261.055063] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [261.055247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [261.055441] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [261.055626] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [261.055810] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [261.055984] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [261.056156] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [261.056322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [261.056515] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [261.056699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [261.056870] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [261.057037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [261.057206] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [261.057391] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [261.057548] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [261.057707] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [261.057869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [261.058028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [261.058183] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [261.058330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [261.058492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [261.058648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [261.058806] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [261.058953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [261.059096] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [261.059237] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [261.059371] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [261.059523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [261.059654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [261.059781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [261.059919] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [261.060043] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [261.060165] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [261.060284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [261.060410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [261.060530] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [261.060655] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [261.060773] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [261.060887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [261.060995] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [261.061103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [261.061213] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [261.061322] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [261.061441] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [261.061549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [261.061657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [261.061759] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [261.061856] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [261.061959] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [261.062662] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [261.062674] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967170, lrc_seqno=4294967170, guc_id=2, flags=0x0 in xe_exec_system_ [5169]
<7> [261.062679] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<7> [261.064198] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [261.064306] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [263.832609] xe 0000:03:00.0: [drm:xe_hwmon_read [xe]] thermal data for group 0 val 0x2b2b2929
<7> [263.833051] xe 0000:03:00.0: [drm:xe_hwmon_read [xe]] thermal data for group 1 val 0x2e2b2c2c
<5> [266.529450] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=36172, lrc_seqno=36172, guc_id=0, flags=0x73 in no process [-1]
<7> [266.529478] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [266.529869] ------------[ cut here ]------------
<4> [266.529877] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [266.529885] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:43/2901
<4> [266.530401] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay binfmt_misc intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart eeepc_wmi spi_nor coretemp asus_wmi sparse_keymap mei_hdcp mtd mei_pxp platform_profile wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel r8169 snd_hda_codec rapl nls_iso8859_1 snd_hda_core usbhid snd_hwdep intel_cstate hid realtek snd_pcm video i2c_i801 snd_timer spi_intel_pci i2c_mux snd spi_intel soundcore i2c_smbus idma64 intel_pmc_core pmt_telemetry mei_me pmt_discovery mei pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi intel_vsec acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [266.530741] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [266.530768] CPU: 7 UID: 0 PID: 2901 Comm: kworker/u64:43 Tainted: G S U W L N 7.0.0-rc7-lgci-xe-xe-4882-645a9910880f44919-debug+ #1 PREEMPT(lazy)
<4> [266.530785] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP, [N]=TEST
<4> [266.530792] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [266.530801] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [266.530830] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [266.531259] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [266.531269] RSP: 0018:ffffc9000423bca0 EFLAGS: 00010246
<4> [266.531282] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000
<4> [266.531291] RDX: ffff888103079410 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0
<4> [266.531298] RBP: ffffc9000423bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [266.531306] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [266.531313] R13: ffff888103079410 R14: ffff888120ae8818 R15: 00000000ffffffc2
<4> [266.531321] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000
<4> [266.531330] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [266.531338] CR2: 000076ae44dcd010 CR3: 000000000344c003 CR4: 0000000000f72ef0
<4> [266.531347] PKRU: 55555554
<4> [266.531354] Call Trace:
<4> [266.531361] <TASK>
<4> [266.531384] ? lock_sync+0x100/0x100
<4> [266.531409] ? lock_release+0xd0/0x2b0
<4> [266.531438] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [266.531469] process_one_work+0x239/0x760
<4> [266.531503] worker_thread+0x200/0x3f0
<4> [266.531517] ? __pfx_worker_thread+0x10/0x10
<4> [266.531531] kthread+0x10d/0x150
<4> [266.531548] ? __pfx_kthread+0x10/0x10
<4> [266.531567] ret_from_fork+0x3d4/0x480
<4> [266.531580] ? __pfx_kthread+0x10/0x10
<4> [266.531598] ret_from_fork_asm+0x1a/0x30
<4> [266.531638] </TASK>
<4> [266.531646] irq event stamp: 608483
<4> [266.531653] hardirqs last enabled at (608489): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [266.531670] hardirqs last disabled at (608494): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [266.531682] softirqs last enabled at (608322): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [266.531697] softirqs last disabled at (608317): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [266.531710] ---[ end trace 0000000000000000 ]---
<6> [266.531720] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [266.532107] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [266.532168] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [266.532604] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [266.533210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [266.533679] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [266.534169] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [266.534626] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [266.534883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [266.534967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [266.535050] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [266.535139] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [266.535225] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [266.535320] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [266.535432] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [266.536449] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [266.547596] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [266.548054] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [266.549919] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [266.550157] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [266.550378] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [266.550599] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [266.550818] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [266.551042] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [266.551295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [266.551530] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [266.551759] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [266.551991] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [266.552239] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [266.552463] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [266.552683] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [266.552894] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [266.553091] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [266.553322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [266.553518] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [266.553715] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [266.553906] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [266.554128] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [266.554335] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [266.554526] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [266.554718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [266.554908] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [266.555088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [266.555291] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [266.555464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [266.555636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [266.555808] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [266.555968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [266.556145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [266.556308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [266.556485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [266.556659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [266.556821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [266.556974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [266.557133] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [266.557274] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [266.557414] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [266.557552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [266.557699] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [266.557845] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [266.557981] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [266.558119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [266.558254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [266.558383] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [266.558510] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [266.558632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [266.558757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [266.558874] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [266.558992] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [266.559116] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [266.559233] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [266.559346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [266.559456] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [266.559567] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [266.559676] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [266.559783] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [266.559893] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [266.560042] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<7> [266.561048] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [266.561196] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [271.650583] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=36172, lrc_seqno=36172, guc_id=0, flags=0x73 in no process [-1]
<7> [271.650612] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [271.651072] ------------[ cut here ]------------
<4> [271.651079] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [271.651087] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:43/2901
<4> [271.651499] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay binfmt_misc intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart eeepc_wmi spi_nor coretemp asus_wmi sparse_keymap mei_hdcp mtd mei_pxp platform_profile wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel r8169 snd_hda_codec rapl nls_iso8859_1 snd_hda_core usbhid snd_hwdep intel_cstate hid realtek snd_pcm video i2c_i801 snd_timer spi_intel_pci i2c_mux snd spi_intel soundcore i2c_smbus idma64 intel_pmc_core pmt_telemetry mei_me pmt_discovery mei pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi intel_vsec acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [271.651904] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [271.651932] CPU: 7 UID: 0 PID: 2901 Comm: kworker/u64:43 Tainted: G S U W L N 7.0.0-rc7-lgci-xe-xe-4882-645a9910880f44919-debug+ #1 PREEMPT(lazy)
<4> [271.651949] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP, [N]=TEST
<4> [271.651957] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [271.651966] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [271.651995] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [271.652386] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [271.652396] RSP: 0018:ffffc9000423bca0 EFLAGS: 00010246
<4> [271.652410] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000
<4> [271.652420] RDX: ffff888103079410 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0
<4> [271.652427] RBP: ffffc9000423bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [271.652434] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [271.652442] R13: ffff888103079410 R14: ffff888120ae8818 R15: 00000000ffffffc2
<4> [271.652449] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000
<4> [271.652458] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [271.652466] CR2: 000076ae44dcd010 CR3: 000000000344c003 CR4: 0000000000f72ef0
<4> [271.652475] PKRU: 55555554
<4> [271.652482] Call Trace:
<4> [271.652489] <TASK>
<4> [271.652512] ? lock_sync+0x100/0x100
<4> [271.652539] ? lock_release+0xd0/0x2b0
<4> [271.652569] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [271.652599] process_one_work+0x239/0x760
<4> [271.652632] worker_thread+0x200/0x3f0
<4> [271.652647] ? __pfx_worker_thread+0x10/0x10
<4> [271.652660] kthread+0x10d/0x150
<4> [271.652676] ? __pfx_kthread+0x10/0x10
<4> [271.652696] ret_from_fork+0x3d4/0x480
<4> [271.652708] ? __pfx_kthread+0x10/0x10
<4> [271.652725] ret_from_fork_asm+0x1a/0x30
<4> [271.652764] </TASK>
<4> [271.652770] irq event stamp: 612487
<4> [271.652776] hardirqs last enabled at (612493): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [271.652791] hardirqs last disabled at (612498): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [271.652803] softirqs last enabled at (611718): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [271.652816] softirqs last disabled at (611713): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [271.652828] ---[ end trace 0000000000000000 ]---
<5> [271.653790] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=36173, lrc_seqno=36173, guc_id=0, flags=0x73 in no process [-1]
<7> [271.653816] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [271.654296] ------------[ cut here ]------------
<4> [271.654303] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [271.654312] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:46/2904
<4> [271.654728] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay binfmt_misc intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart eeepc_wmi spi_nor coretemp asus_wmi sparse_keymap mei_hdcp mtd mei_pxp platform_profile wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel r8169 snd_hda_codec rapl nls_iso8859_1 snd_hda_core usbhid snd_hwdep intel_cstate hid realtek snd_pcm video i2c_i801 snd_timer spi_intel_pci i2c_mux snd spi_intel soundcore i2c_smbus idma64 intel_pmc_core pmt_telemetry mei_me pmt_discovery mei pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi intel_vsec acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [271.655077] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [271.655101] CPU: 2 UID: 0 PID: 2904 Comm: kworker/u64:46 Tainted: G S U W L N 7.0.0-rc7-lgci-xe-xe-4882-645a9910880f44919-debug+ #1 PREEMPT(lazy)
<4> [271.655117] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP, [N]=TEST
<4> [271.655123] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [271.655130] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [271.655157] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [271.655543] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [271.655552] RSP: 0018:ffffc90004e37ca0 EFLAGS: 00010246
<4> [271.655565] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000
<4> [271.655572] RDX: ffff888103079410 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0
<4> [271.655579] RBP: ffffc90004e37db0 R08: 0000000000000000 R09: 0000000000000000
<4> [271.655585] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [271.655592] R13: ffff888103079410 R14: ffff888120ae8818 R15: 00000000ffffffc2
<4> [271.655599] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [271.655606] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [271.655613] CR2: 0000602421bb0658 CR3: 000000000344c001 CR4: 0000000000f72ef0
<4> [271.655621] PKRU: 55555554
<4> [271.655627] Call Trace:
<4> [271.655633] <TASK>
<4> [271.655655] ? lock_sync+0x100/0x100
<4> [271.655679] ? lock_release+0xd0/0x2b0
<4> [271.655708] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [271.655737] process_one_work+0x239/0x760
<4> [271.655768] worker_thread+0x200/0x3f0
<4> [271.655783] ? __pfx_worker_thread+0x10/0x10
<4> [271.655795] kthread+0x10d/0x150
<4> [271.655810] ? __pfx_kthread+0x10/0x10
<4> [271.655829] ret_from_fork+0x3d4/0x480
<4> [271.655840] ? __pfx_kthread+0x10/0x10
<4> [271.655857] ret_from_fork_asm+0x1a/0x30
<4> [271.655908] </TASK>
<4> [271.655914] irq event stamp: 429065
<4> [271.655920] hardirqs last enabled at (429071): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [271.655935] hardirqs last disabled at (429076): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [271.655947] softirqs last enabled at (428294): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [271.655959] softirqs last disabled at (428285): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [271.655971] ---[ end trace 0000000000000000 ]---
<6> [271.655980] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [271.656365] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [271.656398] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [271.656835] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [271.657121] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [271.657208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [271.657296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [271.657380] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [271.657465] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [271.657546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [271.657627] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [271.657709] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [271.657789] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [271.657883] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [271.658004] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [271.659015] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [271.669801] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [271.670115] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [271.671515] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [271.671611] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [271.671701] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [271.671791] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [271.671884] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [271.671972] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [271.672061] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [271.672148] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [271.672238] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [271.672327] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [271.672417] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [271.672506] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [271.672594] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [271.672681] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [271.672768] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [271.672855] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [271.672952] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [271.673036] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [271.673118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [271.673208] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [271.673296] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [271.673381] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [271.673471] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [271.673557] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [271.673637] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [271.673716] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [271.673794] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [271.673882] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [271.673967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [271.674045] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [271.674124] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [271.674200] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [271.674281] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<6> [271.674396] [IGT] xe_exec_system_allocator: finished subtest twice-new-busy, FAIL
<7> [271.674365] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [271.674449] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [271.674528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [271.674607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [271.674681] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [271.674756] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [271.674830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [271.674916] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<6> [271.674996] [IGT] xe_exec_system_allocator: exiting, ret=98
<7> [271.674998] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [271.675078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [271.675150] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [271.675222] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [271.675294] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [271.675364] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<6> [271.675441] Console: switching to colour frame buffer device 240x67
<7> [271.675431] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [271.675504] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [271.675573] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [271.675643] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [271.675713] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [271.675782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [271.675851] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [271.675937] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [271.676021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [271.676097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [271.676167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [271.676242] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [271.676391] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [271.676395] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=36173, lrc_seqno=36173, guc_id=0, flags=0x73 in no process [-1]
<7> [271.676399] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [271.676452] ------------[ cut here ]------------
<4> [271.676454] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [271.676455] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:46/2904
<4> [271.676520] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay binfmt_misc intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart eeepc_wmi spi_nor coretemp asus_wmi sparse_keymap mei_hdcp mtd mei_pxp platform_profile wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel r8169 snd_hda_codec rapl nls_iso8859_1 snd_hda_core usbhid snd_hwdep intel_cstate hid realtek snd_pcm video i2c_i801 snd_timer spi_intel_pci i2c_mux snd spi_intel soundcore i2c_smbus idma64 intel_pmc_core pmt_telemetry mei_me pmt_discovery mei pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi intel_vsec acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [271.676578] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [271.676582] CPU: 2 UID: 0 PID: 2904 Comm: kworker/u64:46 Tainted: G S U W L N 7.0.0-rc7-lgci-xe-xe-4882-645a9910880f44919-debug+ #1 PREEMPT(lazy)
<4> [271.676585] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP, [N]=TEST
<4> [271.676586] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [271.676588] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [271.676592] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [271.676655] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [271.676657] RSP: 0018:ffffc90004e37ca0 EFLAGS: 00010246
<4> [271.676659] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000
<4> [271.676661] RDX: ffff888103079410 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0
<4> [271.676662] RBP: ffffc90004e37db0 R08: 0000000000000000 R09: 0000000000000000
<4> [271.676663] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [271.676664] R13: ffff888103079410 R14: ffff888120ae8818 R15: 00000000ffffffc2
<4> [271.676665] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [271.676667] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [271.676668] CR2: 0000602421bb0658 CR3: 00000001368d2002 CR4: 0000000000f72ef0
<4> [271.676669] PKRU: 55555554
<4> [271.676670] Call Trace:
<4> [271.676671] <TASK>
<4> [271.676675] ? lock_sync+0x100/0x100
<4> [271.676679] ? lock_release+0xd0/0x2b0
<4> [271.676684] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [271.676689] process_one_work+0x239/0x760
<4> [271.676695] worker_thread+0x200/0x3f0
<4> [271.676698] ? __pfx_worker_thread+0x10/0x10
<4> [271.676700] kthread+0x10d/0x150
<4> [271.676702] ? __pfx_kthread+0x10/0x10
<4> [271.676706] ret_from_fork+0x3d4/0x480
<4> [271.676707] ? __pfx_kthread+0x10/0x10
<4> [271.676711] ret_from_fork_asm+0x1a/0x30
<4> [271.676717] </TASK>
<4> [271.676718] irq event stamp: 432213
<4> [271.676719] hardirqs last enabled at (432219): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [271.676722] hardirqs last disabled at (432224): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [271.676724] softirqs last enabled at (431234): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [271.676726] softirqs last disabled at (431229): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [271.676728] ---[ end trace 0000000000000000 ]---
<6> [271.676730] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [271.676795] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [271.676801] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [271.676976] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [271.677181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [271.677258] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [271.677340] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [271.677419] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [271.677498] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [271.677577] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [271.677657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [271.677737] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [271.677812] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [271.677909] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [271.678023] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [271.679024] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [271.689738] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [271.689983] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [271.691159] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [271.691231] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [271.691300] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [271.691371] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [271.691440] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [271.691509] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [271.691577] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [271.691645] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [271.691712] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [271.691779] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [271.691845] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [271.691921] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [271.691996] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [271.692068] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [271.692137] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [271.692206] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [271.692273] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [271.692339] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [271.692404] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [271.692476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [271.692549] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [271.692622] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [271.692695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [271.692766] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [271.692836] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [271.692917] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [271.692988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [271.693059] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [271.693131] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [271.693204] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [271.693275] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [271.693346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [271.693422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [271.693501] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [271.693581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [271.693657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [271.693729] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [271.693800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [271.693872] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [271.693944] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [271.694018] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [271.694088] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [271.694158] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [271.694227] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [271.694302] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [271.694373] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [271.694443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [271.694512] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [271.694582] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [271.694650] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [271.694718] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [271.694789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [271.694859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [271.694940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [271.695007] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [271.695077] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [271.695145] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [271.695216] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [271.695289] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [271.695393] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [271.695402] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=36173, lrc_seqno=36173, guc_id=0, flags=0x73 in no process [-1]
<7> [271.695409] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [271.695621] ------------[ cut here ]------------
<4> [271.695623] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [271.695625] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#15: kworker/u64:44/2902
<4> [271.695741] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay binfmt_misc intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart eeepc_wmi spi_nor coretemp asus_wmi sparse_keymap mei_hdcp mtd mei_pxp platform_profile wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel r8169 snd_hda_codec rapl nls_iso8859_1 snd_hda_core usbhid snd_hwdep intel_cstate hid realtek snd_pcm video i2c_i801 snd_timer spi_intel_pci i2c_mux snd spi_intel soundcore i2c_smbus idma64 intel_pmc_core pmt_telemetry mei_me pmt_discovery mei pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi intel_vsec acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [271.695844] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [271.695852] CPU: 15 UID: 0 PID: 2902 Comm: kworker/u64:44 Tainted: G S U W L N 7.0.0-rc7-lgci-xe-xe-4882-645a9910880f44919-debug+ #1 PREEMPT(lazy)
<4> [271.695856] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP, [N]=TEST
<4> [271.695858] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [271.695860] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [271.695894] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [271.696018] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [271.696020] RSP: 0000:ffffc90004243ca0 EFLAGS: 00010246
<4> [271.696024] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000
<4> [271.696026] RDX: ffff888103079410 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0
<4> [271.696028] RBP: ffffc90004243db0 R08: 0000000000000000 R09: 0000000000000000
<4> [271.696030] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [271.696032] R13: ffff888103079410 R14: ffff888120ae8818 R15: 00000000ffffffc2
<4> [271.696035] FS: 0000000000000000(0000) GS:ffff8888db417000(0000) knlGS:0000000000000000
<4> [271.696037] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [271.696039] CR2: 000076ae44dbe000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [271.696041] PKRU: 55555554
<4> [271.696043] Call Trace:
<4> [271.696045] <TASK>
<4> [271.696051] ? lock_sync+0x100/0x100
<4> [271.696060] ? lock_release+0xd0/0x2b0
<4> [271.696069] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [271.696078] process_one_work+0x239/0x760
<4> [271.696090] worker_thread+0x200/0x3f0
<4> [271.696094] ? __pfx_worker_thread+0x10/0x10
<4> [271.696098] kthread+0x10d/0x150
<4> [271.696102] ? __pfx_kthread+0x10/0x10
<4> [271.696108] ret_from_fork+0x3d4/0x480
<4> [271.696111] ? __pfx_kthread+0x10/0x10
<4> [271.696116] ret_from_fork_asm+0x1a/0x30
<4> [271.696128] </TASK>
<4> [271.696130] irq event stamp: 826539
<4> [271.696132] hardirqs last enabled at (826545): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [271.696136] hardirqs last disabled at (826550): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [271.696139] softirqs last enabled at (826366): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [271.696142] softirqs last disabled at (826311): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [271.696145] ---[ end trace 0000000000000000 ]---
<7> [271.696384] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [271.696482] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [271.697477] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=36174, lrc_seqno=36174, guc_id=0, flags=0x73 in no process [-1]
<7> [271.697482] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [271.697556] ------------[ cut here ]------------
<4> [271.697558] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<7> [271.697515] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma.
<4> [271.697559] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:43/2901
<4> [271.697638] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay binfmt_misc intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart eeepc_wmi spi_nor coretemp asus_wmi sparse_keymap mei_hdcp mtd mei_pxp platform_profile wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel r8169 snd_hda_codec rapl nls_iso8859_1 snd_hda_core usbhid snd_hwdep intel_cstate hid realtek snd_pcm video i2c_i801 snd_timer spi_intel_pci i2c_mux snd spi_intel soundcore i2c_smbus idma64 intel_pmc_core pmt_telemetry mei_me pmt_discovery mei pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi intel_vsec acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [271.697703] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [271.697707] CPU: 7 UID: 0 PID: 2901 Comm: kworker/u64:43 Tainted: G S U W L N 7.0.0-rc7-lgci-xe-xe-4882-645a9910880f44919-debug+ #1 PREEMPT(lazy)
<4> [271.697711] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP, [N]=TEST
<4> [271.697712] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [271.697713] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [271.697719] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [271.697794] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [271.697796] RSP: 0018:ffffc9000423bca0 EFLAGS: 00010246
<4> [271.697798] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000
<4> [271.697799] RDX: ffff888103079410 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0
<4> [271.697801] RBP: ffffc9000423bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [271.697802] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [271.697803] R13: ffff888103079410 R14: ffff888120ae8818 R15: 00000000ffffffc2
<4> [271.697804] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000
<4> [271.697806] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [271.697807] CR2: 000076ae44dcd010 CR3: 000000000344c003 CR4: 0000000000f72ef0
<4> [271.697809] PKRU: 55555554
<4> [271.697810] Call Trace:
<4> [271.697811] <TASK>
<4> [271.697815] ? lock_sync+0x100/0x100
<4> [271.697820] ? lock_release+0xd0/0x2b0
<4> [271.697826] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [271.697831] process_one_work+0x239/0x760
<4> [271.697837] worker_thread+0x200/0x3f0
<4> [271.697840] ? __pfx_worker_thread+0x10/0x10
<4> [271.697842] kthread+0x10d/0x150
<4> [271.697845] ? __pfx_kthread+0x10/0x10
<4> [271.697849] ret_from_fork+0x3d4/0x480
<4> [271.697851] ? __pfx_kthread+0x10/0x10
<4> [271.697854] ret_from_fork_asm+0x1a/0x30
<4> [271.697862] </TASK>
<4> [271.697863] irq event stamp: 613497
<4> [271.697873] hardirqs last enabled at (613515): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [271.697876] hardirqs last disabled at (613520): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [271.697879] softirqs last enabled at (613512): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [271.697881] softirqs last disabled at (613503): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [271.697884] ---[ end trace 0000000000000000 ]---
<6> [271.697887] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [271.697965] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [271.697973] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [271.697930] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma.
<7> [271.698310] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [271.698530] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma.
<7> [271.698571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [271.698708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [271.698844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [271.698988] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [271.699119] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [271.699248] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [271.699379] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [271.699511] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [271.699640] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [271.699781] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [271.699952] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [271.701283] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [271.712056] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [271.712365] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [271.713555] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [271.713674] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [271.713791] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [271.713919] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [271.714039] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [271.714158] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [271.714277] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [271.714395] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [271.714513] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [271.714631] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [271.714749] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [271.714872] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [271.714992] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [271.715110] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [271.715229] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [271.715347] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [271.715466] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [271.715585] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [271.715703] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [271.715826] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [271.715997] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [271.716099] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [271.716190] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [271.716276] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [271.716360] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [271.716443] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [271.716525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [271.716608] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [271.716693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [271.716776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [271.716860] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [271.716967] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [271.717055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [271.717141] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [271.717225] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [271.717306] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [271.717385] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [271.717462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [271.717538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [271.717613] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [271.717692] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [271.717769] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [271.717844] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [271.717939] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [271.718025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [271.718105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [271.718182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [271.718260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [271.718339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [271.718415] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [271.718492] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [271.718571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [271.718647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [271.718724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [271.718799] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [271.718881] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [271.718960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [271.719038] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [271.719118] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [271.719241] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [271.719246] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=36174, lrc_seqno=36174, guc_id=0, flags=0x73 in no process [-1]
<7> [271.719249] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [271.719307] ------------[ cut here ]------------
<4> [271.719309] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [271.719310] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:44/2902
<4> [271.719382] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay binfmt_misc intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart eeepc_wmi spi_nor coretemp asus_wmi sparse_keymap mei_hdcp mtd mei_pxp platform_profile wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel r8169 snd_hda_codec rapl nls_iso8859_1 snd_hda_core usbhid snd_hwdep intel_cstate hid realtek snd_pcm video i2c_i801 snd_timer spi_intel_pci i2c_mux snd spi_intel soundcore i2c_smbus idma64 intel_pmc_core pmt_telemetry mei_me pmt_discovery mei pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi intel_vsec acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [271.719446] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [271.719450] CPU: 0 UID: 0 PID: 2902 Comm: kworker/u64:44 Tainted: G S U W L N 7.0.0-rc7-lgci-xe-xe-4882-645a9910880f44919-debug+ #1 PREEMPT(lazy)
<4> [271.719454] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP, [N]=TEST
<4> [271.719455] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [271.719456] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [271.719461] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [271.719531] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [271.719533] RSP: 0000:ffffc90004243ca0 EFLAGS: 00010246
<4> [271.719536] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000
<4> [271.719537] RDX: ffff888103079410 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0
<4> [271.719538] RBP: ffffc90004243db0 R08: 0000000000000000 R09: 0000000000000000
<4> [271.719540] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [271.719541] R13: ffff888103079410 R14: ffff888120ae8818 R15: 00000000ffffffc2
<4> [271.719542] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000
<4> [271.719544] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [271.719545] CR2: 000000c000595000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [271.719547] PKRU: 55555554
<4> [271.719548] Call Trace:
<4> [271.719549] <TASK>
<4> [271.719553] ? lock_sync+0x100/0x100
<4> [271.719558] ? lock_release+0xd0/0x2b0
<4> [271.719563] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [271.719569] process_one_work+0x239/0x760
<4> [271.719575] worker_thread+0x200/0x3f0
<4> [271.719578] ? __pfx_worker_thread+0x10/0x10
<4> [271.719580] kthread+0x10d/0x150
<4> [271.719583] ? __pfx_kthread+0x10/0x10
<4> [271.719587] ret_from_fork+0x3d4/0x480
<4> [271.719589] ? __pfx_kthread+0x10/0x10
<4> [271.719592] ret_from_fork_asm+0x1a/0x30
<4> [271.719600] </TASK>
<4> [271.719601] irq event stamp: 829789
<4> [271.719602] hardirqs last enabled at (829795): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [271.719605] hardirqs last disabled at (829800): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [271.719607] softirqs last enabled at (828914): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [271.719610] softirqs last disabled at (828909): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [271.719612] ---[ end trace 0000000000000000 ]---
<6> [271.719614] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [271.719684] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [271.719820] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [271.719997] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [271.720201] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [271.720287] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [271.720375] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [271.720459] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [271.720543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [271.720632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [271.720719] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [271.720805] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [271.720895] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [271.720989] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [271.721103] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [271.722110] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [271.731919] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [271.732187] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [271.733256] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [271.733337] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [271.733414] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [271.733491] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [271.733567] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [271.733641] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [271.733714] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [271.733788] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [271.733867] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [271.733946] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [271.734020] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [271.734096] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [271.734172] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [271.734247] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [271.734322] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [271.734396] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [271.734469] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [271.734544] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [271.734619] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [271.734701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [271.734781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [271.734861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [271.734956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [271.735034] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [271.735112] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [271.735189] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [271.735266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [271.735345] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [271.735425] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [271.735503] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [271.735584] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [271.735666] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [271.735752] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [271.735837] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [271.735929] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [271.736010] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [271.736089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [271.736167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [271.736243] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [271.736319] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [271.736397] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [271.736478] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [271.736556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [271.736632] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [271.736712] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [271.736789] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [271.736871] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [271.736950] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [271.737026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [271.737100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [271.737176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [271.737254] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [271.737330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [271.737406] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [271.737482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [271.737559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [271.737633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [271.737708] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [271.737787] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [271.737903] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [271.737908] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=36174, lrc_seqno=36174, guc_id=0, flags=0x73 in no process [-1]
<7> [271.737910] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [271.737970] ------------[ cut here ]------------
<4> [271.737971] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [271.737973] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#0: kworker/u64:44/2902
<4> [271.738046] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay binfmt_misc intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart eeepc_wmi spi_nor coretemp asus_wmi sparse_keymap mei_hdcp mtd mei_pxp platform_profile wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel r8169 snd_hda_codec rapl nls_iso8859_1 snd_hda_core usbhid snd_hwdep intel_cstate hid realtek snd_pcm video i2c_i801 snd_timer spi_intel_pci i2c_mux snd spi_intel soundcore i2c_smbus idma64 intel_pmc_core pmt_telemetry mei_me pmt_discovery mei pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi intel_vsec acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [271.738109] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [271.738114] CPU: 0 UID: 0 PID: 2902 Comm: kworker/u64:44 Tainted: G S U W L N 7.0.0-rc7-lgci-xe-xe-4882-645a9910880f44919-debug+ #1 PREEMPT(lazy)
<4> [271.738117] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP, [N]=TEST
<4> [271.738118] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [271.738119] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [271.738124] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [271.738193] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [271.738195] RSP: 0000:ffffc90004243ca0 EFLAGS: 00010246
<4> [271.738197] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000
<4> [271.738199] RDX: ffff888103079410 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0
<4> [271.738200] RBP: ffffc90004243db0 R08: 0000000000000000 R09: 0000000000000000
<4> [271.738202] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [271.738203] R13: ffff888103079410 R14: ffff888120ae8818 R15: 00000000ffffffc2
<4> [271.738204] FS: 0000000000000000(0000) GS:ffff8888dac97000(0000) knlGS:0000000000000000
<4> [271.738206] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [271.738207] CR2: 000000c000595000 CR3: 000000000344c006 CR4: 0000000000f72ef0
<4> [271.738208] PKRU: 55555554
<4> [271.738210] Call Trace:
<4> [271.738211] <TASK>
<4> [271.738215] ? lock_sync+0x100/0x100
<4> [271.738219] ? lock_release+0xd0/0x2b0
<4> [271.738225] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [271.738230] process_one_work+0x239/0x760
<4> [271.738236] worker_thread+0x200/0x3f0
<4> [271.738239] ? __pfx_worker_thread+0x10/0x10
<4> [271.738242] kthread+0x10d/0x150
<4> [271.738244] ? __pfx_kthread+0x10/0x10
<4> [271.738248] ret_from_fork+0x3d4/0x480
<4> [271.738250] ? __pfx_kthread+0x10/0x10
<4> [271.738253] ret_from_fork_asm+0x1a/0x30
<4> [271.738261] </TASK>
<4> [271.738262] irq event stamp: 832873
<4> [271.738263] hardirqs last enabled at (832879): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [271.738266] hardirqs last disabled at (832884): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [271.738268] softirqs last enabled at (831764): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [271.738270] softirqs last disabled at (831759): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [271.738273] ---[ end trace 0000000000000000 ]---
<5> [271.739384] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=36176, lrc_seqno=36176, guc_id=0, flags=0x73 in no process [-1]
<7> [271.739388] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [271.739452] ------------[ cut here ]------------
<4> [271.739454] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [271.739455] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:46/2904
<7> [271.739453] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<4> [271.739528] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay binfmt_misc intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart eeepc_wmi spi_nor coretemp asus_wmi sparse_keymap mei_hdcp mtd mei_pxp platform_profile wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel r8169 snd_hda_codec rapl nls_iso8859_1 snd_hda_core usbhid snd_hwdep intel_cstate hid realtek snd_pcm video i2c_i801 snd_timer spi_intel_pci i2c_mux snd spi_intel soundcore i2c_smbus idma64 intel_pmc_core pmt_telemetry mei_me pmt_discovery mei pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi intel_vsec acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [271.739593] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [271.739598] CPU: 2 UID: 0 PID: 2904 Comm: kworker/u64:46 Tainted: G S U W L N 7.0.0-rc7-lgci-xe-xe-4882-645a9910880f44919-debug+ #1 PREEMPT(lazy)
<4> [271.739601] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP, [N]=TEST
<4> [271.739602] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [271.739604] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<7> [271.739561] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<4> [271.739608]
<4> [271.739609] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [271.739680] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [271.739681] RSP: 0018:ffffc90004e37ca0 EFLAGS: 00010246
<4> [271.739684] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000
<4> [271.739685] RDX: ffff888103079410 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0
<4> [271.739686] RBP: ffffc90004e37db0 R08: 0000000000000000 R09: 0000000000000000
<4> [271.739688] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [271.739689] R13: ffff888103079410 R14: ffff888120ae8818 R15: 00000000ffffffc2
<4> [271.739690] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [271.739692] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [271.739693] CR2: 0000602421bb0658 CR3: 00000001368d2002 CR4: 0000000000f72ef0
<4> [271.739694] PKRU: 55555554
<4> [271.739696] Call Trace:
<4> [271.739697] <TASK>
<4> [271.739701] ? lock_sync+0x100/0x100
<4> [271.739705] ? lock_release+0xd0/0x2b0
<4> [271.739711] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [271.739716] process_one_work+0x239/0x760
<4> [271.739722] worker_thread+0x200/0x3f0
<4> [271.739725] ? __pfx_worker_thread+0x10/0x10
<4> [271.739727] kthread+0x10d/0x150
<4> [271.739730] ? __pfx_kthread+0x10/0x10
<4> [271.739734] ret_from_fork+0x3d4/0x480
<4> [271.739736] ? __pfx_kthread+0x10/0x10
<4> [271.739739] ret_from_fork_asm+0x1a/0x30
<4> [271.739747] </TASK>
<4> [271.739748] irq event stamp: 435651
<4> [271.739749] hardirqs last enabled at (435657): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [271.739752] hardirqs last disabled at (435662): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [271.739754] softirqs last enabled at (434464): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [271.739756] softirqs last disabled at (434459): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [271.739759] ---[ end trace 0000000000000000 ]---
<6> [271.739761] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [271.739830] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [271.739837] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [271.740253] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [271.740462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [271.740553] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [271.740647] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [271.740735] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [271.740821] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [271.740915] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [271.741005] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [271.741095] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [271.741178] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [271.741273] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [271.741405] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [271.742415] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [271.752869] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [271.753117] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [271.754132] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [271.754210] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [271.754289] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [271.754367] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [271.754443] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [271.754519] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [271.754594] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [271.754666] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [271.754739] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [271.754812] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [271.754892] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [271.754965] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [271.755041] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [271.755118] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [271.755195] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [271.755270] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [271.755343] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [271.755416] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [271.755489] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [271.755568] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [271.755649] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [271.755731] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [271.755813] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [271.755900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [271.755980] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [271.756057] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [271.756134] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [271.756214] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [271.756293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [271.756370] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [271.756446] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [271.756525] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [271.756610] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [271.756696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [271.756781] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [271.756866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [271.756945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [271.757021] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [271.757097] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [271.757172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [271.757250] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [271.757326] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [271.757402] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [271.757477] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [271.757559] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [271.757636] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [271.757714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [271.757792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [271.757877] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [271.757953] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [271.758028] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [271.758105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [271.758182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [271.758259] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [271.758333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [271.758409] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [271.758487] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [271.758564] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [271.758645] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [271.758756] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [271.758761] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=36176, lrc_seqno=36176, guc_id=0, flags=0x73 in no process [-1]
<7> [271.758763] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [271.758822] ------------[ cut here ]------------
<4> [271.758823] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [271.758824] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#7: kworker/u64:43/2901
<4> [271.758904] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay binfmt_misc intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart eeepc_wmi spi_nor coretemp asus_wmi sparse_keymap mei_hdcp mtd mei_pxp platform_profile wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel r8169 snd_hda_codec rapl nls_iso8859_1 snd_hda_core usbhid snd_hwdep intel_cstate hid realtek snd_pcm video i2c_i801 snd_timer spi_intel_pci i2c_mux snd spi_intel soundcore i2c_smbus idma64 intel_pmc_core pmt_telemetry mei_me pmt_discovery mei pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi intel_vsec acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [271.758969] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [271.758974] CPU: 7 UID: 0 PID: 2901 Comm: kworker/u64:43 Tainted: G S U W L N 7.0.0-rc7-lgci-xe-xe-4882-645a9910880f44919-debug+ #1 PREEMPT(lazy)
<4> [271.758977] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP, [N]=TEST
<4> [271.758978] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [271.758980] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [271.758985] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [271.759054] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [271.759056] RSP: 0018:ffffc9000423bca0 EFLAGS: 00010246
<4> [271.759058] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000
<4> [271.759059] RDX: ffff888103079410 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0
<4> [271.759061] RBP: ffffc9000423bdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [271.759062] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [271.759063] R13: ffff888103079410 R14: ffff888120ae8818 R15: 00000000ffffffc2
<4> [271.759065] FS: 0000000000000000(0000) GS:ffff8888db017000(0000) knlGS:0000000000000000
<4> [271.759066] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [271.759067] CR2: 000076ae44dcd010 CR3: 000000000344c003 CR4: 0000000000f72ef0
<4> [271.759069] PKRU: 55555554
<4> [271.759070] Call Trace:
<4> [271.759071] <TASK>
<4> [271.759075] ? lock_sync+0x100/0x100
<4> [271.759080] ? lock_release+0xd0/0x2b0
<4> [271.759086] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [271.759091] process_one_work+0x239/0x760
<4> [271.759098] worker_thread+0x200/0x3f0
<4> [271.759100] ? __pfx_worker_thread+0x10/0x10
<4> [271.759103] kthread+0x10d/0x150
<4> [271.759106] ? __pfx_kthread+0x10/0x10
<4> [271.759109] ret_from_fork+0x3d4/0x480
<4> [271.759111] ? __pfx_kthread+0x10/0x10
<4> [271.759115] ret_from_fork_asm+0x1a/0x30
<4> [271.759122] </TASK>
<4> [271.759123] irq event stamp: 616953
<4> [271.759124] hardirqs last enabled at (616959): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [271.759127] hardirqs last disabled at (616964): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [271.759129] softirqs last enabled at (616038): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [271.759132] softirqs last disabled at (616015): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [271.759134] ---[ end trace 0000000000000000 ]---
<6> [271.759136] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [271.759206] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [271.759212] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [271.760641] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [271.760745] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [271.760970] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [271.761172] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [271.761260] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [271.761353] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [271.761440] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [271.761528] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [271.761615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [271.761701] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [271.761787] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00000100
<7> [271.761872] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [271.761967] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [271.762082] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [271.763088] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [271.772868] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [271.773118] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [271.774146] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [271.774224] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [271.774299] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [271.774377] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [271.774454] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [271.774530] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [271.774604] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [271.774678] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [271.774751] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [271.774824] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [271.774905] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [271.774979] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [271.775052] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [271.775126] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [271.775199] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [271.775272] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [271.775345] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [271.775418] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [271.775494] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [271.775576] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [271.775659] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [271.775736] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [271.775816] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [271.775900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [271.775976] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [271.776053] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [271.776130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [271.776210] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [271.776290] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [271.776367] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [271.776445] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [271.776523] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [271.776607] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [271.776691] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [271.776779] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009100
<7> [271.776866] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [271.776948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [271.777025] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [271.777101] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [271.777177] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [271.777256] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [271.777333] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [271.777410] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [271.777485] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [271.777565] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [271.777640] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [271.777720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [271.777800] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [271.777883] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [271.777960] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [271.778036] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [271.778117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [271.778194] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [271.778271] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [271.778346] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [271.778423] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [271.778497] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [271.778571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [271.778649] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [271.778760] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [271.778764] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=36176, lrc_seqno=36176, guc_id=0, flags=0x73 in no process [-1]
<7> [271.778766] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [271.778825] ------------[ cut here ]------------
<4> [271.778826] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [271.778827] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1626 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:46/2904
<4> [271.778907] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_lb mei_gsc_proxy mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit overlay binfmt_misc intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic cmdlinepart eeepc_wmi spi_nor coretemp asus_wmi sparse_keymap mei_hdcp mtd mei_pxp platform_profile wmi_bmof kvm_intel kvm irqbypass ghash_clmulni_intel snd_intel_dspcfg aesni_intel r8169 snd_hda_codec rapl nls_iso8859_1 snd_hda_core usbhid snd_hwdep intel_cstate hid realtek snd_pcm video i2c_i801 snd_timer spi_intel_pci i2c_mux snd spi_intel soundcore i2c_smbus idma64 intel_pmc_core pmt_telemetry mei_me pmt_discovery mei pmt_class intel_pmc_ssram_telemetry pinctrl_alderlake wmi intel_vsec acpi_tad acpi_pad dm_multipath msr nvme_fabrics fuse efi_pstore
<4> [271.778971] nfnetlink autofs4 [last unloaded: snd_hda_intel]
<4> [271.778976] CPU: 2 UID: 0 PID: 2904 Comm: kworker/u64:46 Tainted: G S U W L N 7.0.0-rc7-lgci-xe-xe-4882-645a9910880f44919-debug+ #1 PREEMPT(lazy)
<4> [271.778979] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN, [L]=SOFTLOCKUP, [N]=TEST
<4> [271.778980] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 1656 04/18/2024
<4> [271.778981] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [271.778986] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [271.779057] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 06 d6 5e e1 48 89 c6 48 8d 3d 3c 96 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [271.779059] RSP: 0018:ffffc90004e37ca0 EFLAGS: 00010246
<4> [271.779061] RAX: ffffffffa1202f13 RBX: 0000000000000000 RCX: 0000000000000000
<4> [271.779062] RDX: ffff888103079410 RSI: ffffffffa1202f13 RDI: ffffffffa1003ee0
<4> [271.779064] RBP: ffffc90004e37db0 R08: 0000000000000000 R09: 0000000000000000
<4> [271.779065] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [271.779066] R13: ffff888103079410 R14: ffff888120ae8818 R15: 00000000ffffffc2
<4> [271.779067] FS: 0000000000000000(0000) GS:ffff8888dad97000(0000) knlGS:0000000000000000
<4> [271.779069] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [271.779070] CR2: 0000602421bb0658 CR3: 00000001368d2002 CR4: 0000000000f72ef0
<4> [271.779072] PKRU: 55555554
<4> [271.779073] Call Trace:
<4> [271.779074] <TASK>
<4> [271.779078] ? lock_sync+0x100/0x100
<4> [271.779083] ? lock_release+0xd0/0x2b0
<4> [271.779088] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [271.779093] process_one_work+0x239/0x760
<4> [271.779099] worker_thread+0x200/0x3f0
<4> [271.779102] ? __pfx_worker_thread+0x10/0x10
<4> [271.779104] kthread+0x10d/0x150
<4> [271.779107] ? __pfx_kthread+0x10/0x10
<4> [271.779111] ret_from_fork+0x3d4/0x480
<4> [271.779113] ? __pfx_kthread+0x10/0x10
<4> [271.779116] ret_from_fork_asm+0x1a/0x30
<4> [271.779123] </TASK>
<4> [271.779124] irq event stamp: 438909
<4> [271.779126] hardirqs last enabled at (438915): [<ffffffff814aacd9>] __up_console_sem+0x79/0xa0
<4> [271.779128] hardirqs last disabled at (438920): [<ffffffff814aacbe>] __up_console_sem+0x5e/0xa0
<4> [271.779130] softirqs last enabled at (437906): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [271.779133] softirqs last disabled at (437901): [<ffffffff813d1e9f>] __irq_exit_rcu+0x13f/0x160
<4> [271.779135] ---[ end trace 0000000000000000 ]---
<7> [271.780265] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [271.780371] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [271.781066] xe 0000:03:00.0: [drm:drm_pagemap_dev_unhold_work [drm_gpusvm_helper]] Releasing reference on provider device and module.
<7> [271.791076] xe 0000:03:00.0: [drm:drm_client_dev_restore] fbdev: ret=0
|