Results for igt@xe_exec_system_allocator@many-large-mmap-shared-remap-dontunmap

Result: Abort 28 Warning(s)

i915_display_info9 igt_runner9 results9.json results9-xe-load.json guc_logs9.tar i915_display_info_post_exec9 boot9 dmesg9

DetailValue
Duration unknown
Hostname 
shard-bmg-4
Igt-Version 
IGT-Version: 2.3-gce787a44a (x86_64) (Linux: 7.0.0-rc5-lgci-xe-xe-4762-5cb7d14d9bd206138-debug+ x86_64)
Out 
Using IGT_SRANDOM=1774294803 for randomisation
Opened device: /dev/dri/card0
Starting subtest: many-large-mmap-shared-remap-dontunmap
Stack trace:
  #0 ../lib/igt_core.c:2075 __igt_fail_assert()
  #1 [xe_wait_ufence+0x57]
  #2 ../tests/intel/xe_exec_system_allocator.c:1757 test_exec()
  #3 ../tests/intel/xe_exec_system_allocator.c:2572 __igt_unique____real_main2349()
  #4 ../tests/intel/xe_exec_system_allocator.c:2349 main()
  #5 [__libc_init_first+0x8a]
  #6 [__libc_start_main+0x8b]
  #7 [_start+0x25]
Subtest many-large-mmap-shared-remap-dontunmap: FAIL (5.543s)

This test caused an abort condition: Kernel badly tainted (0x244, 0x200) (check dmesg for details):
	TAINT_WARN: WARN_ON has happened.
Err 
Starting subtest: many-large-mmap-shared-remap-dontunmap
(xe_exec_system_allocator:8680) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:758:
(xe_exec_system_allocator:8680) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0
(xe_exec_system_allocator:8680) xe/xe_ioctl-CRITICAL: Last errno: 62, Timer expired
(xe_exec_system_allocator:8680) xe/xe_ioctl-CRITICAL: error: -62 != 0
Subtest many-large-mmap-shared-remap-dontunmap failed.
**** DEBUG ****
(xe_exec_system_allocator:8680) xe/xe_ioctl-CRITICAL: Test assertion failure function xe_wait_ufence, file ../lib/xe/xe_ioctl.c:758:
(xe_exec_system_allocator:8680) xe/xe_ioctl-CRITICAL: Failed assertion: __xe_wait_ufence(fd, addr, value, exec_queue, &timeout) == 0
(xe_exec_system_allocator:8680) xe/xe_ioctl-CRITICAL: Last errno: 62, Timer expired
(xe_exec_system_allocator:8680) xe/xe_ioctl-CRITICAL: error: -62 != 0
(xe_exec_system_allocator:8680) igt_core-INFO: Stack trace:
(xe_exec_system_allocator:8680) igt_core-INFO:   #0 ../lib/igt_core.c:2075 __igt_fail_assert()
(xe_exec_system_allocator:8680) igt_core-INFO:   #1 [xe_wait_ufence+0x57]
(xe_exec_system_allocator:8680) igt_core-INFO:   #2 ../tests/intel/xe_exec_system_allocator.c:1757 test_exec()
(xe_exec_system_allocator:8680) igt_core-INFO:   #3 ../tests/intel/xe_exec_system_allocator.c:2572 __igt_unique____real_main2349()
(xe_exec_system_allocator:8680) igt_core-INFO:   #4 ../tests/intel/xe_exec_system_allocator.c:2349 main()
(xe_exec_system_allocator:8680) igt_core-INFO:   #5 [__libc_init_first+0x8a]
(xe_exec_system_allocator:8680) igt_core-INFO:   #6 [__libc_start_main+0x8b]
(xe_exec_system_allocator:8680) igt_core-INFO:   #7 [_start+0x25]
****  END  ****
Subtest many-large-mmap-shared-remap-dontunmap: FAIL (5.543s)
Dmesg

Scroll to first warning
<6> [560.261758] Console: switching to colour dummy device 80x25
<6> [560.262109] [IGT] xe_exec_system_allocator: executing
<6> [560.278706] [IGT] xe_exec_system_allocator: starting subtest many-large-mmap-shared-remap-dontunmap
<7> [560.279049] xe 0000:03:00.0: [drm:drm_pagemap_dev_unhold_work [drm_gpusvm_helper]] Releasing reference on provider device and module.
<7> [561.755487] xe 0000:03:00.0: [drm:intel_power_well_enable [xe]] enabling AUX_TC2
<7> [561.859537] xe 0000:03:00.0: [drm:intel_power_well_disable [xe]] disabling AUX_TC2
<7> [565.066847] xe 0000:03:00.0: [drm:xe_hwmon_read [xe]] thermal data for group 0 val 0x2b2a2828
<7> [565.066999] xe 0000:03:00.0: [drm:xe_hwmon_read [xe]] thermal data for group 1 val 0x2c2c2c2c
<7> [565.790670] xe 0000:03:00.0: [drm:xe_hw_engine_snapshot_capture [xe]] Tile0: GT0: Proceeding with manual engine snapshot
<4> [565.791222] ------------[ cut here ]------------
<4> [565.791228] xe 0000:03:00.0: [drm] Tile0: GT0: Unexpected engine class:instance 3:8 for context utilization
<4> [565.791236] WARNING: drivers/gpu/drm/xe/xe_lrc.c:2557 at xe_lrc_timestamp+0x196/0x460 [xe], CPU#4: kworker/u64:47/2758
<4> [565.791662] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_pxp mei_hdcp sparse_keymap mtd platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel r8169 rapl snd_intel_dspcfg snd_hda_codec intel_cstate snd_hda_core video snd_hwdep snd_pcm realtek binfmt_misc snd_timer snd i2c_i801 i2c_mux mei_me spi_intel_pci soundcore i2c_smbus idma64 spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi intel_vsec acpi_pad pinctrl_alderlake acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [565.791977] autofs4 [last unloaded: snd_hda_intel]
<4> [565.791995] CPU: 4 UID: 0 PID: 2758 Comm: kworker/u64:47 Tainted: G S U 7.0.0-rc5-lgci-xe-xe-4762-5cb7d14d9bd206138-debug+ #1 PREEMPT(lazy)
<4> [565.792010] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER
<4> [565.792015] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023
<4> [565.792022] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [565.792049] RIP: 0010:xe_lrc_timestamp+0x1a7/0x460 [xe]
<4> [565.792528] Code: b6 79 26 48 89 55 c8 88 45 d0 e8 14 b2 5c e1 48 89 c6 48 8d 3d 5a c8 37 00 0f b6 4d d0 41 54 45 89 e9 45 0f b6 c7 48 8b 55 c8 <67> 48 0f b9 3a 58 eb 91 41 0f b6 bd 99 0f 00 00 e8 64 d8 03 00 41
<4> [565.792537] RSP: 0018:ffffc90001abfc00 EFLAGS: 00010246
<4> [565.792548] RAX: ffffffffa11ff347 RBX: 0000000000000000 RCX: 0000000000000000
<4> [565.792555] RDX: ffff888101b9b490 RSI: ffffffffa11ff347 RDI: ffffffffa1004e20
<4> [565.792561] RBP: ffffc90001abfc90 R08: 0000000000000000 R09: 0000000000000003
<4> [565.792567] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000008
<4> [565.792572] R13: 0000000000000003 R14: ffff8881314e8e00 R15: 0000000000000000
<4> [565.792577] FS: 0000000000000000(0000) GS:ffff8888dae98000(0000) knlGS:0000000000000000
<4> [565.792585] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [565.792591] CR2: 00007f2ef12c0000 CR3: 000000000344c000 CR4: 0000000000f52ef0
<4> [565.792598] PKRU: 55555554
<4> [565.792604] Call Trace:
<4> [565.792609] <TASK>
<4> [565.792628] ? xe_lrc_start_seqno+0x33/0x70 [xe]
<4> [565.793029] guc_exec_queue_timedout_job+0xf80/0x2400 [xe]
<4> [565.793487] ? lock_acquire+0x20/0x2f0
<4> [565.793515] ? lock_release+0xd0/0x2b0
<4> [565.793541] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [565.793571] process_one_work+0x239/0x760
<4> [565.793603] worker_thread+0x200/0x3f0
<4> [565.793616] ? __pfx_worker_thread+0x10/0x10
<4> [565.793627] kthread+0x10d/0x150
<4> [565.793642] ? __pfx_kthread+0x10/0x10
<4> [565.793659] ret_from_fork+0x3d4/0x480
<4> [565.793670] ? __pfx_kthread+0x10/0x10
<4> [565.793687] ret_from_fork_asm+0x1a/0x30
<4> [565.793724] </TASK>
<4> [565.793730] irq event stamp: 1767343
<4> [565.793735] hardirqs last enabled at (1767349): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0
<4> [565.793750] hardirqs last disabled at (1767354): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0
<4> [565.793761] softirqs last enabled at (1767266): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [565.793773] softirqs last disabled at (1767261): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [565.793784] ---[ end trace 0000000000000000 ]---
<7> [565.793796] xe 0000:03:00.0: [drm:guc_exec_queue_timedout_job [xe]] Tile0: GT0: Check job timeout: seqno=32818, lrc_seqno=32818, guc_id=0, running_time_ms=231842, timeout_ms=5000, diff=0xfcb03931
<6> [565.822022] [IGT] xe_exec_system_allocator: finished subtest many-large-mmap-shared-remap-dontunmap, FAIL
<6> [565.822995] [IGT] xe_exec_system_allocator: exiting, ret=98
<6> [565.823688] Console: switching to colour frame buffer device 240x67
<6> [566.435671] xe 0000:03:00.0: [drm] Tile0: GT0: Engine reset: engine_class=bcs, logical_mask: 0x2, guc_id=0, state=0x209
<5> [566.436497] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=32818, lrc_seqno=32818, guc_id=0, flags=0x73 in no process [-1]
<6> [566.618123] xe 0000:03:00.0: [drm] Xe device coredump has been created
<6> [566.618145] xe 0000:03:00.0: [drm] Check your /sys/class/drm/card0/device/devcoredump/data
<4> [566.618148] ------------[ cut here ]------------
<4> [566.618149] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [566.618150] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#5: kworker/u64:47/2758
<4> [566.618237] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_pxp mei_hdcp sparse_keymap mtd platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel r8169 rapl snd_intel_dspcfg snd_hda_codec intel_cstate snd_hda_core video snd_hwdep snd_pcm realtek binfmt_misc snd_timer snd i2c_i801 i2c_mux mei_me spi_intel_pci soundcore i2c_smbus idma64 spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi intel_vsec acpi_pad pinctrl_alderlake acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [566.618333] autofs4 [last unloaded: snd_hda_intel]
<4> [566.618337] CPU: 5 UID: 0 PID: 2758 Comm: kworker/u64:47 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-4762-5cb7d14d9bd206138-debug+ #1 PREEMPT(lazy)
<4> [566.618340] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [566.618341] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023
<4> [566.618343] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [566.618349] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [566.618441] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [566.618443] RSP: 0018:ffffc90001abfca0 EFLAGS: 00010246
<4> [566.618445] RAX: ffffffffa11ff347 RBX: 0000000000000000 RCX: 0000000000000000
<4> [566.618447] RDX: ffff888101b9b490 RSI: ffffffffa11ff347 RDI: ffffffffa1003dd0
<4> [566.618448] RBP: ffffc90001abfdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [566.618449] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [566.618451] R13: ffff888101b9b490 R14: ffff8881d8180000 R15: 00000000ffffffc2
<4> [566.618452] FS: 0000000000000000(0000) GS:ffff8888daf18000(0000) knlGS:0000000000000000
<4> [566.618454] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [566.618455] CR2: 00007f2ef0abd000 CR3: 000000000344c000 CR4: 0000000000f52ef0
<4> [566.618458] PKRU: 55555554
<4> [566.618459] Call Trace:
<4> [566.618461] <TASK>
<4> [566.618465] ? lock_acquire+0x20/0x2f0
<4> [566.618472] ? __pfx_autoremove_wake_function+0x10/0x10
<4> [566.618477] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [566.618482] process_one_work+0x239/0x760
<4> [566.618489] worker_thread+0x200/0x3f0
<4> [566.618492] ? __pfx_worker_thread+0x10/0x10
<4> [566.618494] kthread+0x10d/0x150
<4> [566.618497] ? __pfx_kthread+0x10/0x10
<4> [566.618500] ret_from_fork+0x3d4/0x480
<4> [566.618503] ? __pfx_kthread+0x10/0x10
<4> [566.618506] ret_from_fork_asm+0x1a/0x30
<4> [566.618513] </TASK>
<4> [566.618514] irq event stamp: 1768903
<4> [566.618515] hardirqs last enabled at (1768909): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0
<4> [566.618518] hardirqs last disabled at (1768914): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0
<4> [566.618520] softirqs last enabled at (1768012): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [566.618523] softirqs last disabled at (1768007): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [566.618525] ---[ end trace 0000000000000000 ]---
<6> [566.618527] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [566.618594] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [566.618796] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [566.618892] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [566.619476] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [566.619581] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [566.619668] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [566.619747] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [566.619825] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [566.619902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [566.619978] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [566.620050] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [566.620135] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [566.620238] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [566.621389] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [566.632166] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [566.632466] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [566.634023] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [566.634104] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [566.634178] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [566.634249] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [566.634339] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [566.634418] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [566.634495] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [566.634570] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [566.634644] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [566.634719] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [566.634791] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [566.634866] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [566.634938] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [566.635012] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [566.635085] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [566.635159] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [566.635232] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [566.635314] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [566.635389] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [566.635474] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [566.635556] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [566.635635] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [566.635714] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [566.635791] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [566.635869] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [566.635948] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [566.636024] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [566.636103] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [566.636181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [566.636262] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [566.636339] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [566.636416] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [566.636499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [566.636580] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [566.636661] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [566.636741] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [566.636818] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [566.636893] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [566.636968] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [566.637041] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [566.637117] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [566.637192] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [566.637270] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [566.637344] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [566.637422] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [566.637496] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [566.637571] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [566.637644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [566.637720] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [566.637792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [566.637863] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [566.637938] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [566.638011] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [566.638085] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [566.638157] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [566.638231] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [566.638313] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [566.638388] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [566.638465] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [566.638997] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [566.639003] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=4294967169, lrc_seqno=4294967169, guc_id=2, flags=0x0 in xe_exec_system_ [8680]
<7> [566.639006] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<7> [566.641045] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [566.641167] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [571.933557] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=32818, lrc_seqno=32818, guc_id=0, flags=0x73 in no process [-1]
<7> [571.933588] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [571.934026] ------------[ cut here ]------------
<4> [571.934033] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [571.934041] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#12: kworker/u64:13/2720
<4> [571.934575] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_pxp mei_hdcp sparse_keymap mtd platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel r8169 rapl snd_intel_dspcfg snd_hda_codec intel_cstate snd_hda_core video snd_hwdep snd_pcm realtek binfmt_misc snd_timer snd i2c_i801 i2c_mux mei_me spi_intel_pci soundcore i2c_smbus idma64 spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi intel_vsec acpi_pad pinctrl_alderlake acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [571.934964] autofs4 [last unloaded: snd_hda_intel]
<4> [571.934988] CPU: 12 UID: 0 PID: 2720 Comm: kworker/u64:13 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-4762-5cb7d14d9bd206138-debug+ #1 PREEMPT(lazy)
<4> [571.935005] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [571.935012] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023
<4> [571.935022] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [571.935054] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [571.935526] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [571.935537] RSP: 0018:ffffc900069e7ca0 EFLAGS: 00010246
<4> [571.935552] RAX: ffffffffa11ff347 RBX: 0000000000000000 RCX: 0000000000000000
<4> [571.935561] RDX: ffff888101b9b490 RSI: ffffffffa11ff347 RDI: ffffffffa1003dd0
<4> [571.935569] RBP: ffffc900069e7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [571.935578] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [571.935586] R13: ffff888101b9b490 R14: ffff88811f1a3818 R15: 00000000ffffffc2
<4> [571.935596] FS: 0000000000000000(0000) GS:ffff8888db298000(0000) knlGS:0000000000000000
<4> [571.935606] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [571.935615] CR2: 0000756ea700b048 CR3: 000000000344c000 CR4: 0000000000f52ef0
<4> [571.935625] PKRU: 55555554
<4> [571.935632] Call Trace:
<4> [571.935640] <TASK>
<4> [571.935669] ? lock_acquire+0x20/0x2f0
<4> [571.935706] ? lock_release+0xd0/0x2b0
<4> [571.935742] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [571.935780] process_one_work+0x239/0x760
<4> [571.935824] worker_thread+0x200/0x3f0
<4> [571.935842] ? __pfx_worker_thread+0x10/0x10
<4> [571.935856] kthread+0x10d/0x150
<4> [571.935874] ? __pfx_kthread+0x10/0x10
<4> [571.935896] ret_from_fork+0x3d4/0x480
<4> [571.935908] ? __pfx_kthread+0x10/0x10
<4> [571.935929] ret_from_fork_asm+0x1a/0x30
<4> [571.935981] </TASK>
<4> [571.935988] irq event stamp: 372245
<4> [571.935996] hardirqs last enabled at (372251): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0
<4> [571.936012] hardirqs last disabled at (372256): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0
<4> [571.936026] softirqs last enabled at (371498): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [571.936040] softirqs last disabled at (371491): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [571.936053] ---[ end trace 0000000000000000 ]---
<6> [571.936132] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [571.936693] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [571.937664] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [571.938104] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [571.939111] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [571.939657] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [571.939942] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [571.940022] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [571.940100] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [571.940176] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [571.940264] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [571.940346] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [571.940439] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [571.940550] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [571.941561] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [571.952292] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [571.953325] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [571.955134] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [571.955416] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [571.955632] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [571.955839] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [571.956051] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [571.956275] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [571.956484] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [571.956701] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [571.956915] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [571.957114] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [571.957332] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [571.957529] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [571.957729] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [571.957920] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [571.958107] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [571.958306] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [571.958482] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [571.958657] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [571.958830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [571.959031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [571.959218] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [571.959428] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [571.959609] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [571.959786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [571.959956] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [571.960118] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [571.960277] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [571.960439] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [571.960600] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [571.960750] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [571.960900] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [571.961049] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [571.961199] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [571.961369] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [571.961516] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [571.961654] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [571.961792] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [571.961925] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [571.962055] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [571.962182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [571.962325] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [571.962451] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [571.962574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [571.962696] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [571.962824] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [571.962936] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [571.963052] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [571.963167] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [571.963293] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [571.963403] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [571.963513] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [571.963620] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [571.963724] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [571.963830] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [571.963934] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [571.964037] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [571.964136] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [571.964238] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [571.964340] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [571.964490] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<7> [571.965811] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [571.965949] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<5> [577.054376] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=32818, lrc_seqno=32818, guc_id=0, flags=0x73 in no process [-1]
<7> [577.054418] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [577.054805] ------------[ cut here ]------------
<4> [577.054812] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [577.054819] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#4: kworker/u64:13/2720
<4> [577.055332] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_pxp mei_hdcp sparse_keymap mtd platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel r8169 rapl snd_intel_dspcfg snd_hda_codec intel_cstate snd_hda_core video snd_hwdep snd_pcm realtek binfmt_misc snd_timer snd i2c_i801 i2c_mux mei_me spi_intel_pci soundcore i2c_smbus idma64 spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi intel_vsec acpi_pad pinctrl_alderlake acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [577.055665] autofs4 [last unloaded: snd_hda_intel]
<4> [577.055689] CPU: 4 UID: 0 PID: 2720 Comm: kworker/u64:13 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-4762-5cb7d14d9bd206138-debug+ #1 PREEMPT(lazy)
<4> [577.055705] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [577.055712] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023
<4> [577.055721] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [577.055751] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [577.056182] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [577.056191] RSP: 0018:ffffc900069e7ca0 EFLAGS: 00010246
<4> [577.056205] RAX: ffffffffa11ff347 RBX: 0000000000000000 RCX: 0000000000000000
<4> [577.056214] RDX: ffff888101b9b490 RSI: ffffffffa11ff347 RDI: ffffffffa1003dd0
<4> [577.056221] RBP: ffffc900069e7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [577.056228] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [577.056235] R13: ffff888101b9b490 R14: ffff88811f1a3818 R15: 00000000ffffffc2
<4> [577.056243] FS: 0000000000000000(0000) GS:ffff8888dae98000(0000) knlGS:0000000000000000
<4> [577.056252] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [577.056260] CR2: 000000062d3ff000 CR3: 000000000344c000 CR4: 0000000000f52ef0
<4> [577.056269] PKRU: 55555554
<4> [577.056275] Call Trace:
<4> [577.056282] <TASK>
<4> [577.056303] ? lock_acquire+0x20/0x2f0
<4> [577.056335] ? lock_release+0xd0/0x2b0
<4> [577.056362] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [577.056392] process_one_work+0x239/0x760
<4> [577.056424] worker_thread+0x200/0x3f0
<4> [577.056439] ? __pfx_worker_thread+0x10/0x10
<4> [577.056452] kthread+0x10d/0x150
<4> [577.056468] ? __pfx_kthread+0x10/0x10
<4> [577.056487] ret_from_fork+0x3d4/0x480
<4> [577.056499] ? __pfx_kthread+0x10/0x10
<4> [577.056516] ret_from_fork_asm+0x1a/0x30
<4> [577.056555] </TASK>
<4> [577.056563] irq event stamp: 376111
<4> [577.056571] hardirqs last enabled at (376117): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0
<4> [577.056587] hardirqs last disabled at (376122): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0
<4> [577.056600] softirqs last enabled at (375366): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [577.056614] softirqs last disabled at (375359): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [577.056627] ---[ end trace 0000000000000000 ]---
<5> [577.064122] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=32843, lrc_seqno=32843, guc_id=0, flags=0x73 in no process [-1]
<7> [577.064147] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [577.064471] ------------[ cut here ]------------
<4> [577.064477] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [577.064485] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#10: kworker/u64:31/2738
<4> [577.064873] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_pxp mei_hdcp sparse_keymap mtd platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel r8169 rapl snd_intel_dspcfg snd_hda_codec intel_cstate snd_hda_core video snd_hwdep snd_pcm realtek binfmt_misc snd_timer snd i2c_i801 i2c_mux mei_me spi_intel_pci soundcore i2c_smbus idma64 spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi intel_vsec acpi_pad pinctrl_alderlake acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [577.065207] autofs4 [last unloaded: snd_hda_intel]
<4> [577.065226] CPU: 10 UID: 0 PID: 2738 Comm: kworker/u64:31 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-4762-5cb7d14d9bd206138-debug+ #1 PREEMPT(lazy)
<4> [577.065240] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [577.065246] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023
<4> [577.065252] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [577.065277] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [577.065639] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [577.065647] RSP: 0018:ffffc9000734fca0 EFLAGS: 00010246
<4> [577.065658] RAX: ffffffffa11ff347 RBX: 0000000000000000 RCX: 0000000000000000
<4> [577.065665] RDX: ffff888101b9b490 RSI: ffffffffa11ff347 RDI: ffffffffa1003dd0
<4> [577.065671] RBP: ffffc9000734fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [577.065676] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [577.065681] R13: ffff888101b9b490 R14: ffff88811f1a3818 R15: 00000000ffffffc2
<4> [577.065688] FS: 0000000000000000(0000) GS:ffff8888db198000(0000) knlGS:0000000000000000
<4> [577.065695] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [577.065701] CR2: 00007abc8b5924d0 CR3: 0000000126d30000 CR4: 0000000000f52ef0
<4> [577.065708] PKRU: 55555554
<4> [577.065713] Call Trace:
<4> [577.065719] <TASK>
<4> [577.065740] ? lock_acquire+0x20/0x2f0
<4> [577.065768] ? lock_release+0xd0/0x2b0
<4> [577.065793] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [577.065821] process_one_work+0x239/0x760
<4> [577.065851] worker_thread+0x200/0x3f0
<4> [577.065864] ? __pfx_worker_thread+0x10/0x10
<4> [577.065875] kthread+0x10d/0x150
<4> [577.065888] ? __pfx_kthread+0x10/0x10
<4> [577.065906] ret_from_fork+0x3d4/0x480
<4> [577.065915] ? __pfx_kthread+0x10/0x10
<4> [577.065930] ret_from_fork_asm+0x1a/0x30
<4> [577.065966] </TASK>
<4> [577.065971] irq event stamp: 1019935
<4> [577.065977] hardirqs last enabled at (1019941): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0
<4> [577.066023] hardirqs last disabled at (1019948): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0
<4> [577.066036] softirqs last enabled at (1019134): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [577.066048] softirqs last disabled at (1019125): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [577.066058] ---[ end trace 0000000000000000 ]---
<7> [577.065885] xe 0000:03:00.0: [drm:xe_svm_garbage_collector [xe]] Skipping madvise reset for vma.
<6> [577.066068] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [577.066427] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [577.066457] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [577.066891] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [577.067603] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [577.068230] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [577.068782] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [577.069327] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [577.069855] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [577.070378] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [577.070903] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [577.071436] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [577.072024] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [577.072713] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [577.074228] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [577.085154] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 10ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [577.085405] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [577.086632] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [577.086704] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [577.086771] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [577.086839] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [577.086906] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [577.086972] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [577.087053] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [577.087124] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [577.087194] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [577.087263] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [577.087333] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [577.087403] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [577.087474] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [577.087542] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [577.087612] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [577.087682] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [577.087749] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [577.087819] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [577.087887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [577.087966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [577.088054] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [577.088130] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [577.088205] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [577.088278] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [577.088352] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [577.088426] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [577.088499] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [577.088574] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [577.088648] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [577.088721] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [577.088793] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [577.088867] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [577.088945] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [577.089031] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [577.089108] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [577.089182] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [577.089255] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [577.089324] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [577.089395] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [577.089467] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [577.089543] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [577.089615] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [577.089687] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [577.089757] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [577.089832] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [577.089902] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [577.089974] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [577.090056] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [577.090127] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [577.090197] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [577.090266] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [577.090338] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [577.090407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [577.090480] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [577.090552] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [577.090625] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [577.090695] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [577.090765] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [577.090838] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [577.091114] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [577.091119] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=32843, lrc_seqno=32843, guc_id=0, flags=0x73 in no process [-1]
<7> [577.091122] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [577.091180] ------------[ cut here ]------------
<4> [577.091181] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [577.091182] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#2: kworker/u64:31/2738
<4> [577.091254] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_pxp mei_hdcp sparse_keymap mtd platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel r8169 rapl snd_intel_dspcfg snd_hda_codec intel_cstate snd_hda_core video snd_hwdep snd_pcm realtek binfmt_misc snd_timer snd i2c_i801 i2c_mux mei_me spi_intel_pci soundcore i2c_smbus idma64 spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi intel_vsec acpi_pad pinctrl_alderlake acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [577.091312] autofs4 [last unloaded: snd_hda_intel]
<4> [577.091316] CPU: 2 UID: 0 PID: 2738 Comm: kworker/u64:31 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-4762-5cb7d14d9bd206138-debug+ #1 PREEMPT(lazy)
<4> [577.091319] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [577.091320] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023
<4> [577.091321] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [577.091326] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [577.091393] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [577.091395] RSP: 0018:ffffc9000734fca0 EFLAGS: 00010246
<4> [577.091397] RAX: ffffffffa11ff347 RBX: 0000000000000000 RCX: 0000000000000000
<4> [577.091398] RDX: ffff888101b9b490 RSI: ffffffffa11ff347 RDI: ffffffffa1003dd0
<4> [577.091399] RBP: ffffc9000734fdb0 R08: 0000000000000000 R09: 0000000000000000
<4> [577.091400] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [577.091401] R13: ffff888101b9b490 R14: ffff88811f1a3818 R15: 00000000ffffffc2
<4> [577.091402] FS: 0000000000000000(0000) GS:ffff8888dad98000(0000) knlGS:0000000000000000
<4> [577.091404] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [577.091405] CR2: 000059ef1c0dca08 CR3: 000000000344c000 CR4: 0000000000f52ef0
<4> [577.091406] PKRU: 55555554
<4> [577.091407] Call Trace:
<4> [577.091408] <TASK>
<4> [577.091412] ? lock_acquire+0x20/0x2f0
<4> [577.091418] ? lock_release+0xd0/0x2b0
<4> [577.091423] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [577.091428] process_one_work+0x239/0x760
<4> [577.091434] worker_thread+0x200/0x3f0
<4> [577.091437] ? __pfx_worker_thread+0x10/0x10
<4> [577.091439] kthread+0x10d/0x150
<4> [577.091442] ? __pfx_kthread+0x10/0x10
<4> [577.091445] ret_from_fork+0x3d4/0x480
<4> [577.091447] ? __pfx_kthread+0x10/0x10
<4> [577.091450] ret_from_fork_asm+0x1a/0x30
<4> [577.091457] </TASK>
<4> [577.091458] irq event stamp: 1023083
<4> [577.091459] hardirqs last enabled at (1023089): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0
<4> [577.091461] hardirqs last disabled at (1023094): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0
<4> [577.091463] softirqs last enabled at (1021960): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [577.091466] softirqs last disabled at (1021951): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [577.091468] ---[ end trace 0000000000000000 ]---
<6> [577.091469] xe 0000:03:00.0: [drm] Tile0: GT0: trying reset from guc_exec_queue_timedout_job [xe]
<6> [577.091538] xe 0000:03:00.0: [drm] Tile0: GT0: reset queued
<6> [577.091544] xe 0000:03:00.0: [drm] Tile0: GT0: reset started
<7> [577.092561] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [577.092666] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [577.092874] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel stopped
<7> [577.093090] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying GT save-restore MMIOs
<7> [577.093188] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x4148] = 0x00000000
<7> [577.093284] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x8828] = 0x00800000
<7> [577.093374] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb0c8] = 0x11111440
<7> [577.093460] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb104] = 0x08104440
<7> [577.093546] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb108] = 0x30200000
<7> [577.093630] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xb158] = 0x0000007f
<7> [577.093711] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] WOPCM: 4096K
<7> [577.093808] xe 0000:03:00.0: [drm:xe_wopcm_init [xe]] GuC WOPCM is already locked [6144K, 832K)
<7> [577.093926] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel disabled
<7> [577.095012] xe 0000:03:00.0: [drm:xe_guc_ads_populate [xe]] Tile0: GT0: Updated ADS capture size 20480 (was 49152)
<7> [577.104997] xe 0000:03:00.0: [drm:guc_wait_ucode [xe]] Tile0: GT0: GuC load: init took 9ms, freq = 2150MHz (req = 2133MHz), before = 2150MHz, status = 0x8002F034
<7> [577.105247] xe 0000:03:00.0: [drm:guc_ct_change_state [xe]] Tile0: GT0: GuC CT communication channel enabled
<7> [577.106295] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: flag:0x1
<7> [577.106379] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: mocs entries: 16
<7> [577.106455] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[0] 0x4000 0xc
<7> [577.106531] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[1] 0x4004 0x10c
<7> [577.106609] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[2] 0x4008 0x130
<7> [577.106686] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[3] 0x400c 0x13c
<7> [577.106762] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[4] 0x4010 0x100
<7> [577.106838] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[5] 0x4014 0x100
<7> [577.106913] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[6] 0x4018 0x100
<7> [577.106989] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[7] 0x401c 0x100
<7> [577.107064] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[8] 0x4020 0x100
<7> [577.107135] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[9] 0x4024 0x100
<7> [577.107207] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[10] 0x4028 0x100
<7> [577.107280] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[11] 0x402c 0x100
<7> [577.107354] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[12] 0x4030 0x100
<7> [577.107427] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[13] 0x4034 0x100
<7> [577.107499] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[14] 0x4038 0x100
<7> [577.107572] xe 0000:03:00.0: [drm:xe_mocs_init [xe]] Tile0: GT0: GLOB_MOCS[15] 0x403c 0x100
<7> [577.107644] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying rcs0 save-restore MMIOs
<7> [577.107728] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x2050] = 0x10001000
<7> [577.107810] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20c4] = 0x3f7e0306
<7> [577.107887] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x20d4] = 0xc080c080
<7> [577.107966] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d0] = 0x00006210
<7> [577.108078] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d4] = 0x000062a8
<7> [577.108155] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24d8] = 0x1000dafc
<7> [577.108232] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24dc] = 0x1000db01
<7> [577.108308] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x24e0] = 0x0000db1c
<7> [577.108386] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe194] = 0x00400040
<7> [577.108464] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe48c] = 0x02000200
<7> [577.108540] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe49c] = 0x40004000
<7> [577.108617] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4c4] = 0x10401040
<7> [577.108693] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe4f0] = 0x00020002
<7> [577.108776] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe530] = 0x00000400
<7> [577.108859] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7c8] = 0x04002000
<7> [577.108940] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0xe7cc] = 0x00009000
<7> [577.109026] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x14800] = 0x00020002
<7> [577.109105] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs0 save-restore MMIOs
<7> [577.109181] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x22050] = 0x10001000
<7> [577.109257] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220c4] = 0x3f7e0306
<7> [577.109330] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x220d4] = 0xc080c080
<7> [577.109407] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying bcs8 save-restore MMIOs
<7> [577.109482] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee050] = 0x10001000
<7> [577.109558] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0c4] = 0x3f7e0306
<7> [577.109633] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x3ee0d4] = 0xc080c080
<7> [577.109711] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs0 save-restore MMIOs
<7> [577.109786] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a050] = 0x10001000
<7> [577.109861] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0c4] = 0x3f7e0308
<7> [577.109935] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a0d4] = 0xc080c080
<7> [577.110015] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d0] = 0x1000dafc
<7> [577.110089] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d4] = 0x1000db01
<7> [577.110163] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1a4d8] = 0x0000db1c
<7> [577.110240] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: Applying ccs1 save-restore MMIOs
<7> [577.110315] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c050] = 0x10001000
<7> [577.110390] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0c4] = 0x3f7e0308
<7> [577.110462] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c0d4] = 0xc080c080
<7> [577.110538] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d0] = 0x1000dafc
<7> [577.110611] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d4] = 0x1000db01
<7> [577.110684] xe 0000:03:00.0: [drm:xe_reg_sr_apply_mmio [xe]] Tile0: GT0: REG[0x1c4d8] = 0x0000db1c
<7> [577.110761] xe 0000:03:00.0: [drm:xe_gt_apply_ccs_mode [xe]] Tile0: GT0: CCS_MODE=fff0fc0 config:00400000, num_engines:1, num_slices:2
<6> [577.110876] xe 0000:03:00.0: [drm] Tile0: GT0: reset done
<5> [577.110880] xe 0000:03:00.0: [drm] Tile0: GT0: Timedout job: seqno=32843, lrc_seqno=32843, guc_id=0, flags=0x73 in no process [-1]
<7> [577.110882] xe 0000:03:00.0: [drm:xe_devcoredump [xe]] Multiple hangs are occurring, but only the first snapshot was taken
<4> [577.110942] ------------[ cut here ]------------
<4> [577.110943] xe 0000:03:00.0: [drm] Tile0: GT0: Kernel-submitted job timed out
<4> [577.110945] WARNING: drivers/gpu/drm/xe/xe_guc_submit.c:1641 at guc_exec_queue_timedout_job+0x1424/0x2400 [xe], CPU#8: kworker/u64:13/2720
<4> [577.111030] Modules linked in: snd_hda_codec_intelhdmi snd_hda_codec_hdmi pmt_crashlog mei_gsc_proxy mei_lb mtd_intel_dg mei_gsc xe drm_gpuvm drm_gpusvm_helper drm_buddy drm_ttm_helper ttm gpu_sched drm_suballoc_helper drm_exec drm_display_helper cec rc_core drm_kunit_helpers i2c_algo_bit kunit intel_rapl_msr intel_rapl_common intel_uncore_frequency intel_uncore_frequency_common intel_tcc_cooling x86_pkg_temp_thermal intel_powerclamp hid_generic coretemp cmdlinepart asus_nb_wmi spi_nor asus_wmi mei_pxp mei_hdcp sparse_keymap mtd platform_profile wmi_bmof kvm_intel usbhid kvm hid irqbypass ghash_clmulni_intel aesni_intel r8169 rapl snd_intel_dspcfg snd_hda_codec intel_cstate snd_hda_core video snd_hwdep snd_pcm realtek binfmt_misc snd_timer snd i2c_i801 i2c_mux mei_me spi_intel_pci soundcore i2c_smbus idma64 spi_intel mei intel_pmc_core pmt_telemetry pmt_discovery pmt_class nls_iso8859_1 intel_pmc_ssram_telemetry wmi intel_vsec acpi_pad pinctrl_alderlake acpi_tad dm_multipath msr nvme_fabrics fuse efi_pstore nfnetlink
<4> [577.111091] autofs4 [last unloaded: snd_hda_intel]
<4> [577.111095] CPU: 8 UID: 0 PID: 2720 Comm: kworker/u64:13 Tainted: G S U W 7.0.0-rc5-lgci-xe-xe-4762-5cb7d14d9bd206138-debug+ #1 PREEMPT(lazy)
<4> [577.111098] Tainted: [S]=CPU_OUT_OF_SPEC, [U]=USER, [W]=WARN
<4> [577.111099] Hardware name: ASUS System Product Name/PRIME Z790-P WIFI, BIOS 0812 02/24/2023
<4> [577.111100] Workqueue: gt-ordered-wq drm_sched_job_timedout [gpu_sched]
<4> [577.111105] RIP: 0010:guc_exec_queue_timedout_job+0x142d/0x2400 [xe]
<4> [577.111178] Code: 74 04 48 8b 7f 08 4c 8b 6f 50 4d 85 ed 75 03 4c 8b 2f e8 96 9a 5e e1 48 89 c6 48 8d 3d 8c a0 39 00 41 89 d8 44 89 e1 4c 89 ea <67> 48 0f b9 3a 48 8b 45 90 48 8b 40 60 e9 c6 ee ff ff 8b 70 08 49
<4> [577.111179] RSP: 0018:ffffc900069e7ca0 EFLAGS: 00010246
<4> [577.111181] RAX: ffffffffa11ff347 RBX: 0000000000000000 RCX: 0000000000000000
<4> [577.111183] RDX: ffff888101b9b490 RSI: ffffffffa11ff347 RDI: ffffffffa1003dd0
<4> [577.111184] RBP: ffffc900069e7db0 R08: 0000000000000000 R09: 0000000000000000
<4> [577.111185] R10: 0000000000000000 R11: 0000000000000000 R12: 0000000000000000
<4> [577.111186] R13: ffff888101b9b490 R14: ffff88811f1a3818 R15: 00000000ffffffc2
<4> [577.111187] FS: 0000000000000000(0000) GS:ffff8888db098000(0000) knlGS:0000000000000000
<4> [577.111189] CS: 0010 DS: 0000 ES: 0000 CR0: 0000000080050033
<4> [577.111190] CR2: 0000743b64e62000 CR3: 0000000126d30000 CR4: 0000000000f52ef0
<4> [577.111191] PKRU: 55555554
<4> [577.111192] Call Trace:
<4> [577.111193] <TASK>
<4> [577.111197] ? lock_acquire+0x20/0x2f0
<4> [577.111202] ? lock_release+0xd0/0x2b0
<4> [577.111208] drm_sched_job_timedout+0x94/0x1a0 [gpu_sched]
<4> [577.111213] process_one_work+0x239/0x760
<4> [577.111219] worker_thread+0x200/0x3f0
<4> [577.111222] ? __pfx_worker_thread+0x10/0x10
<4> [577.111224] kthread+0x10d/0x150
<4> [577.111227] ? __pfx_kthread+0x10/0x10
<4> [577.111230] ret_from_fork+0x3d4/0x480
<4> [577.111232] ? __pfx_kthread+0x10/0x10
<4> [577.111235] ret_from_fork_asm+0x1a/0x30
<4> [577.111242] </TASK>
<4> [577.111243] irq event stamp: 380249
<4> [577.111245] hardirqs last enabled at (380255): [<ffffffff814a9c89>] __up_console_sem+0x79/0xa0
<4> [577.111247] hardirqs last disabled at (380260): [<ffffffff814a9c6e>] __up_console_sem+0x5e/0xa0
<4> [577.111249] softirqs last enabled at (379506): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [577.111252] softirqs last disabled at (379495): [<ffffffff813d0e9f>] __irq_exit_rcu+0x13f/0x160
<4> [577.111254] ---[ end trace 0000000000000000 ]---
<7> [577.112589] xe 0000:03:00.0: [drm:xe_gt_sriov_pf_config_restart [xe]] PF: Tile0: GT0: pushed 0 skip 24 of 24 VFs configurations
<7> [577.112707] xe 0000:03:00.0: [drm:pf_worker_restart_func [xe]] PF: Tile0: GT0: restart completed
<7> [577.112837] xe 0000:03:00.0: [drm:drm_pagemap_dev_unhold_work [drm_gpusvm_helper]] Releasing reference on provider device and module.
<7> [577.128252] xe 0000:03:00.0: [drm:drm_client_dev_restore] fbdev: ret=0
Created at 2026-03-23 20:09:20